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Preface 


“Applied Signal Processing” is a textbook mainly for students, who are studying 
in the Medicine and Technology, Electrical Engineering, Electronics Engineering, 
Computer Engineering and Biomedical Engineering Disciplines. The main objec- 
tive of this book is to provide the students with a solid basis for the analysis and pro- 
cessing of analog and digital signals emanating from either deterministic or stochas- 
tic systems. This book is the outcome of more than two decades of my experience in 
teaching signal processing. For more than ten years, I have been teaching ‘Applied 
Signal Processing’ course to Medicine and Technology students at the Technical 
University of Denmark (Department of Health Technology). It introduces the basic 
concepts, definitions, analysis and implementation of signal processing techniques 
as well as signal processing systems. Since the digital signal processing techniques 
have evolved from its analog counterpart, the book begins by explaining the con- 
cepts in analog signal processing first and then moves towards digital signal pro- 
cessing. This will help the students to gain a general overview of the whole subject 
and establish links between the various concepts. In addition, understanding the 
classical analog signal processing techniques would certainly make it easy for the 
students to understand the digital signal processing counterpart. The book uses a 
number of good illustrations to explain the fundamental concepts in both analog 
and digital signal processing along with examples and numerous exercise problems. 

The book is divided into seventeen chapters that covers the fundamentals of most 
signal processing concepts. In the introduction chapter, some basic signals as well 
as descriptions of some of the most commonly referred types of biomedical signals, 
such as the electroencephalogram (EEG), electrocardiogram (ECG), electromyo- 
gram (EMG), etc., are provided. In Chapter 2, the fundamental concepts of power 
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and energy as well as their evaluations for different types (periodic/aperiodic) of sig- 
nals is provided. Fourier series representation of periodic signals as well as its impor- 
tant properties are provided in Chapter 3. In Chapter 4, the Fourier representation 
of aperiodic analog signals, that is, the Fourier transform is explained. The deriva- 
tion of Fourier transform and its important properties are also explained here. As 
complex signals are the building blocks for the synthesis of different types of signals, 
the fundamentals of complex signals is dealt with in Chapter 5. This chapter also 
introduces the concept of Hilbert transform and analytic signals. The fundamentals 
of analog systems, especially that of linear time invariant (LTT) systems is provided 
in Chapter 6. The process of generating digital signals from analog signals by sam- 
pling and quantization techniques are introduced in the next Chapter. In Chapter 
8, the fundamentals of the z-transform are introduced for the analysis of discrete- 
time signals. Discrete-time Fourier transform (DTFT) as well as its relationships to 
Laplace transform and z-transform are explained in Chapter 9. The fundamentals 
of digital systems are described in detail in Chapter 10. Some of the most impor- 
tant implementation schemes for the digital systems (both finite impulse response 
(FIR) systems as well as infinite impulse response (IIR) systems) are provided in 
the next Chapter. The discrete Fourier transform (DFT) techniques are developed 
in Chapter 12 followed by the concept and derivation of fundamental algorithms 
for fast Fourier transform (FFT) in Chapter 13. Design methods for digital filters 
(both FIR and IIR) are provided in Chapter 14. A detailed description of random/s- 
tochastic processes and characterization methods for random signals are provided 
in Chapter 15. In Chapter 16, the fundamentals of analog and digital modulation 
schemes as well as detection methods are explained. The final chapter introduces 
the power spectrum estimation methods, which could be applied to signals of both 
analog and digital types. The effect of windowing, spectral leakage, and spectral 
smoothing are also explained in this chapter. 

While the main focus of this book is on the fundamentals of digital signal pro- 
cessing, the understanding of these topics greatly enriches our confident use and 
further development of the design and analysis of digital systems for various engi- 
neering and medical applications. This book will also equip students to further 
their studies/research in advanced topics in signal processing. 
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Notations 


[-] indicates discrete valued independent variable, e.g., x[n]. 
(-) indicates continuous valued independent variable, e.g., x(t). 


e Complex numbers 
Ic| Magnitude of complex quantity c. 
arg{c} Phase angle of complex quantity c. 
Re{c}, Real{c} Real part of c. 
Im{c}, Imag{c} Imaginary part of c. 
c* Complex conjugate of c. 
e Complex functions 
ARG{c(@)} Principal value of the phase (—z < ARG{c(@)} < z). 
arg{c(@)} Unwrapped phase (no jumps of 27). 
e Lower-case functions denote time-domain quantities, e.g., x(t), w[n]. 
e Upper-case functions denote frequency or transform domain quantities. 
X[k] Discrete Fourier transform coefficients for x[n]. 
X[k] Fourier series coefficients for x (t). 
X (ei ©) Discrete-time Fourier transform of x[n]. 
X (Q) Fourier transform of x(t). 
X (z) z—transform of x[n]. 
© Boldface lower-case symbols denote vector quantities, e.g., q. 
© Boldface upper-case symbols denote matrix quantities, e.g., A. 
e Subscript s indicates continuous-time representation of a discrete-time signal. 
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Notations, Symbols 


xs (t) continuous-time representation for x[n]. 
Xs(Q) Fourier transform of x; (t). 
e Arctan refers to the four quadrant inverse tangent function and produces a 
value between —z and m radians. 
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Principal Symbols 


xxi 


jori 
Ts 
N 
Q 


u(t), u[n] 
d(t), d[n] 
* or & 
© 
sinc(u) 
Yxx(T) 
Yxy(T) 


Fxx (t) 
rxy(t) 


Pex (f) 
Pxy(f) 
Sxx(f) 
Sxy(f) 


Yxxlm] 
Yxy [m] 
rxx[m] 


Square root of —1. 
Sampling interval of Ts in seconds. 
Fundamental period for discrete-time signals in samples. 
(Angular) frequency for continuous-time signals in 
radians/second. 
(Angular) frequency for discrete-time signals in radians. 
Fundamental (angular) frequency for continuous-time periodic 
signal in radians/second. 
(Angular) frequency for discrete-time periodic signal in radians. 
(Cyclic) frequency of signals (continuous/discrete-time) in Hz. 
Fundamental (cyclic) frequency of periodic signals 
(continuous/discrete-time) in Hz. 
Sampling (cyclic) frequency (= r) in Hz. 
Normalized (cyclic) frequency (= $), 
Step function of unit amplitude. 
Unit impulse. 
Denotes convolution operation. 
Circular convolution. 
sinru) 

mu ` 
Auto-correlation function (ACF) of analog random signal, x(t). 
Cross-correlation function (CCF) between two analog random 
signals, x(t) and y(t). 
ACF of periodic/aperiodic analog signal, x (t). 
CCF between two periodic/aperiodic analog signals, x(t) and 
y(t). 


Power spectra of analog random signal, x(t). 


Cross power spectra of two analog random signals, x(t) and y(t). 


Power (energy) spectra of periodic/aperiodic analog signal, x(t). 
Cross power (energy) spectra of two periodic/aperiodic analog 
signals, x(t) and y(t). 

ACF of discrete-time random signal, x[n]. 

CCF between two discrete-time random signals, x[n] and y[n]. 
ACF of periodic/aperiodic discrete-time signal, x[n]. 
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Fxy [m] 


Dex (f) 
Pry) 


Sxx(f) 
Sy (f) 
My 


Cxx(T) 
Yxx(T) 


Notations, Symbols 


CCF between two periodic/aperiodic discrete-time signals, x[n] 
and y[n]. 

Power spectra of discrete-time random signal, x[n]. 

Cross power spectra of two discrete-time random signals, x[n] 
and y[n]. 

Power (energy) spectra of periodic/aperiodic discrete-time signal, 
x[n]. 

Cross power (energy) spectra of two periodic/aperiodic 
discrete-time signals, x[n] and y[n]. 

Ensemble Mean of the random signal, x(t). 

Covariance function of the random signal, x (t). 

ACF of ergodic random signal, x(t). 
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Signal Representation and Notation 


A summary of various notational conventions used in Digital Signal Processing 
(DSP) for representing signals and spectra is provided below. 


Units 


In this book, time ‘£?’ is always the physical unit of time in seconds (s). The time 
‘n’, ‘m, or ‘K are in units of samples (counting integer numbers having no units). 
Time ‘f’, is a continuous real variable. The physical time ‘t’ corresponding to time 
‘n’ samples is given by, 


t= nTs, 


where, Ts is the sampling interval in seconds. 

For frequencies, we have two physical units: (i) cycles/second (Hertz (Hz)), and 
(ii) radians/second (rad/sec). One cycle equals 27 radians, which is 360°. There- 
fore, f Hz is the same frequency as 2a f rad/sec. 

For example, a periodic signal with a period of p seconds has a frequency of 
fp = + Hz, and a radian frequency of A rad/sec. The sampling rate, fs, is the 
reciprocal of the sampling period Ts, i.e., 


1 
fs = p” 
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Chapter 1 


Introduction 


Signal processing is an interdisciplinary subject which has application in almost 
all scientific fields. There are mainly two subfields to signal processing: (i) Analog 
signal processing and (ii) Digital signal processing. Analog signal (continuous in 
time and amplitude) processing is the processing performed on analog signals to 
extract various types of information from the signal. Typical examples which uses 
analog signal processing include crossover filters in loudspeakers, ‘Bass’, “Treble 
and ‘Volume’ controls on stereos, old televisions, old radios, audio tapes, old land- 
line telephones, video cassette recorders, etc. Digital signal (discrete in time and 
amplitude) processing, on the other hand, is the use of digital processing on signals 
to perform a wide variety of signal processing operations by computers or more 
specialized digital signal processors to extract the relevant information. Digital sig- 
nal processing applications include audio and speech processing, sonar, radar and 
other sensor array processing, spectral density estimation, statistical signal process- 
ing, digital image processing, data/image compression, video/audio coding, signal 
processing for telecommunications, control systems, biomedical engineering, and 
seismology, etc., to list a few. 

The enormous advancement in technology, especially in digital technology dur- 
ing the last couple of decades has revolutionized the way technology has been 
exploited in many scientific fields and digital health field in biomedical engineering 
(medicine and technology) is one of the most benefited. In digital health, digital 
signal processing plays a significant role to research and innovate technologies by 
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working on the various digital bio-signals to revolutionize healthcare and life science 
for the society, in order to enhance the efficiency of healthcare delivery and make 
personalized and precise treatment for individuals. 

Biomedical signals are the observations of physiological activities of organisms. 
It ranges from gene and protein sequences, to neural and cardiac rhythms, to tis- 
sue and organ images. Examples of some of the most commonly used biomedical 
signals are: 


e Electrocardiogram (ECG) — are recordings of the electrical potentials induced 

by the presence of time-varying electrical activity in cardiac muscles, 

e Electromyogram (EMG) — are recordings by placing electrodes in, on, or near 

a muscle and amplifying the electric potential that results from the generation 
and propagation of action potentials along muscle fibers, 

e Eelectroretinogram (ERG) — are recordings of the electrical responses of var- 

ious cell types in the retina, 

e Electrooculogram (EOG) — are recordings of the electrical potentials associ- 

ated with the eye-ball and eye-lid movements, 

e Electrogastrogram (EGG) — are recordings of the electrical signals that travel 

through the stomach muscles, 

e Electroencephalogram (EEG) — are recordings of the electrical activities of 

the brain by placing electrodes on the scalp, and 

e Electrocorticogram (ECoG) — are recordings of the signals directly from the 

cortex. 

Signal processing essentially is the manipulation of signals for the purpose of 
(i) extracting information (amplitude, frequency, or phase) from the signal, (ii) 
extracting information about the relationships of two (or more) signals, or (iii) 
producing alternative representation (time or frequency domain) of the signal. The 
motivations for processing these signals include: (i) removing unwanted signal com- 
ponents (noise/artefacts) that are corrupting the signal of interest, (ii) rendering it 
in a more obvious or more useful form, and (iii) predict future values of the signal 
in order to anticipate the behaviour of its source (modelling). When these process- 
ing methods are applied to the types of signals listed above or similar, it becomes 
biomedical signal processing. Whatever may be the types/sources of signals, the 
basic processing methods are similar as in one is interested to estimate the basic 
signal characteristics such as its amplitude (power), frequency, and phase. 

This book introduces the basic tools and techniques required for the design and 
implementation of systems that process analog and digital signals. This book also 
lays a strong foundation for advanced studies in biomedical engineering, medicine 
and technology, and digital signal processing. The main topics covered in this book 
help us to: (i) Use common Fourier transform (FT) pairs and properties to deter- 
mine the FT of complex analog and digital signals, (ii) Relate spectra of periodic 
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and aperiodic analog and digital signals and plot these using correct physical units 
such as Hertz and Volt, (iii) Determine the auto- and cross-correlation functions of 
analog and digital random signals, (iv) Analyze zero-pole diagrams to determine the 
causality and stability of linear time-invariant systems, (v) Use the z-transform to 
calculate the impulse response and the transfer function of a linear time-invariant 
system, (vi) Determine and analyze the quantization errors in analog-to-digital con- 
version, (vii) Design simple low-pass, high-pass, band-pass, band-stop and notch 
filters, using windowing, frequency sampling, optimization methods, as well as fil- 
ter transformation rules, and (viii) Find the power spectra of random/deterministic 
signals using non-parametric and parametric spectral estimation methods. Knowl- 
edge in these topics will enable anyone, for example, to apply signal processing 
techniques to signals emanating from biological systems (for example, ECG, EEG, 
etc.) and design procedures to estimate parameters such as the heart rate, blood 
velocity and profile of blood flow, etc. 

In this chapter, we discuss some of the very fundamental aspects in the study of 
signals and signal processing. 


1.1 What is a Signal? 


A signal can be considered to be the result of observing a physical phenomenon 
and converting it into its equivalent electrical format. Thus, formally, a signal is a 
function of one or more variables that conveys the information on the nature of a 
physical phenomenon (i.e., current or voltage as a function of e.g., time). Consider 
the following practical scenarios: 


e A microphone converts our speech into an electrical signal. This signal can be 
used to record our speech or for making our speech heard to a large group of 
people through an amplifier and loudspeaker. 

e A temperature sensor connected to the boiler in a chemical plant measures 
the temperature continuously and converts the temperature readings into an 
electrical signal. This signal can be used to display the temperature for moni- 
toring by the plant engineer or can be recorded for later use. 

e A security camera placed at a building site captures the images of all the 
objects that come under its view and converts these images into electrical sig- 
nals and stores them in a database for later review. 

e The ECG signals recorded by placing electrodes on the chest of a patient/sub- 
ject convey the information on the condition of his/her heart. 


In short, any time-varying phenomenon which conveys some information is a signal. 
The usefulness of the information conveyed by a signal depends on the application 
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Figure 1.1. Sinusoidal signal. 
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Figure 1.2. Exponentially decaying signal. 


under consideration. Thus, in general, a signal can be considered as a function of 
time. We can also have signals that are functions of quantities other than time, such 
as distance, temperature, height, etc. To specify a signal, we need to specify the value 
of the signal at all the instants of time under consideration. Consider some typical 
example signals below, that one encounter in signal processing. 


1. A sinusoidal signal (Fig. 1.1) is mathematically described by, 
x(t) = Asin(2zfpt + $) (1.1) 


where A denotes the amplitude (e.g., A = 3), fp denotes the frequency in 
Hertz or cycles/second (e.g., fp = 50Hz), and ¢ denotes the phase of the 
sinusoid (e.g., @ = 4 radians, which is equivalent to’ 45 degrees). Thus, x(t) 
gives the value of the signal at time instant t and this value can be calculated 
using the expression on the right-hand side (RHS) of Eq. (1.1) for any value 
of t (if the values of A, fp and ¢ are given). 

2. An exponentially decaying signal (Fig. 1.2) can be defined mathematically by, 


Ae fort >0 
OS p fort <0 (a 


where A denotes the value of the signal at t = O and a is a positive number 
(a = 2.1 in this case) that controls the speed with which the signal value 


1. Note: [angle in degrees] = [angle in radians] x 180/z. 
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Figure 1.5. Signum function. 


decays towards zero. Larger the value of a, faster it reaches towards zero and 


vice versa. 


3. The unit rectangular pulse signal (Fig. 1.3) is given by, 


rect(t) = | 0 


otherwise 
4, The unit step (function) signal (Fig. 1.4) is given by, 


Ge 1 fort > 0 
“OF lo fort <0 


5. The signum function signal (Fig. 1.5) is given by, 


sgn(t) = +1 fort > 0 
g ~ |—1 fort <0 


6. A triangular pulse signal (Fig. 1.6) is given by, 


1+¢t for-Il<t<0O 
yt)= yl—-t forO<t<+41 
0 otherwise 


1 for—0.5 <t < +0.5 


(1.3) 


(1.4) 


(1.5) 


(1.6) 
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Figure 1.6. Triangular pulse. 


§ Plot the time-shifted versions u(t —2) and u(t +2) ofu(t) and compare these plots with 
u(t) in Fig. 1.4. Comment on your observations. 


1.2 Classification of Signals 


There are several ways by which signals can be classified. 


1.21 Analog or Digital Signals 


This classification is based on the values allowed for the time ‘’ and signal ‘x(t)’. 
A strictly analog signal has its time and amplitude continuous, whereas a digital 
signal has its time and amplitude discrete. 


e Continuous-Time Signals: A signal is said to be a ‘continuous-time signal’ if 
it is defined (or, if it exists) at all the instants of time during any interval under 
consideration. Examples are the signals given in Eqs. (1.1)—(1.6) above. 

e Discrete-Time Signals: A signal is said to be a ‘discrete-time signal’ if it 
is defined only at discrete set of instants of time rather than a// the time 


instants. 


We can generate discrete-time signals from continuous-time signals by, for 
example, sampling the signals at regular instants of time given by kT;, where k 
is an integer and T; is the time duration between any two adjacent samples. 
Thus, the discrete-time version of the sinusoidal signal in Eq. (1.1) can be 


given by, 
x[k] = x(kT;) =[x(t) at t= kT] 
= Asin(QafpkT; + ?), (1.7) 
fork =...,—2,—1,0,1,2,3,.... 


Figure 1.7 illustrates both the continuous (blue) and discrete-time (red) sig- 
nals corresponding to the sinusoidal signal defined in Eq. (1.1). 
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Figure 1.7. Sinusoidal signal (continuous-time and discrete-time). 


We use the notation x[k] to represent a discrete-time signal’ since this 
signal is defined only at the discrete-time instants, kT;. Since this notation, 
x[k], does not explicitly show what the time interval Tẹ is between adjacent 
samples, we may provide this information by specifying the Sample rate’ in 
the form of number of samples per second’. Thus, if fs is the sample rate, then 
we have T; = 1/fy. 

Another example of such a signal is the discrete-time unit step signal 


given by, 


1 fork =0,1,2,3,... 


0 fork <0 ie) 


u[k] = | 


§ Since most of the real-world signals are continuous-time signals, why should we 
be interested in the study of discrete-time signals? 


§ Are there real-world signals that are discrete-time in nature? 


e Continuous-Value Signals: A signal is said to be a ‘continuous-value signal’ if 
its value is allowed to be anywhere in a given range. For example, the value 
of the sinusoidal signal in Eq. (1.1) varies between the range —A and +A, 
and the value of the signal in Eq. (1.2) varies between 0 and +A. So, these 
are continuous-value signals. 

e Discrete-Value Signals: A signal is said to be a ‘discrete-value signal’ if its value 
is restricted to a discrete set of values rather than all the values in a given range. 


An example for a discrete-value signal can be constructed as follows. 

Let By fork = 0,1,2,... . represents a sequence of binary data. That is, 
Bx can take only two values and let these values be either ‘1’ or ‘0’. Thus, this 
sequence of binary data form a discrete-time signal given by, 


z[k] = Bx, (1.9) 


where the signal exists at time instants kT, (here, 1/T; specifies the data rate, 
i.e., number of bits per second) and its value at any such instant is either ‘1’ 


2. Other notation used for representing discrete-time signals is xx. 
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Figure 1.9. Continuous-time discrete-value signals. 


or ‘0’. In other words, z[k] is a discrete-time discrete-value signal. An example 
of such a signal is shown in Fig. 1.8. You may note that values of the signals 
are either ‘1’ or ‘0’ and it exists at discrete time instances. 

Continuous-time Discrete-value Signals: We can also have continuous-time 
discrete-value signals. For example, we can convert the discrete-time discrete- 
value signal z[k] in Eq. (1.9) into a continuous-time discrete-value signal as 


follows: 
Z(t) = 0.9Bk for kT; < t < (k + DT. (1.10) 


Here, the multiplication factor, 0.9 is just an arbitrary scalar constant. 
In other words, during the time interval kT, < t < (k + 1)Ts, we get 


2 0.9 if Be =1, 
= 1.11 
aD lo if Be = 0. oe 
Thus, we see that Z(t) is a continuous-time discrete-value signal and it takes 
only two values ‘0.9’ and ‘0’ at any time instant t. This signal Z(t) is illustrated 
in Fig. 1.9 above. 


§ Let the binary data sequence By be given by [0, 1,1, 0,0,0, 1,0, 0, 1, 0] for 
k=0,1,2,..., 10. Using the definitions of signals given in Eqs. (1.9) and (1.10), 
draw the resulting discrete-time discrete-value signal’ z(k) and ‘continuous-time 


discrete-value signal Z(t). 
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Figure 1.10. Discrete-time discrete-value signals. 


e Discrete-time Discrete-value Signals: We can also generate discrete-value 


signals through the process of quantization. For example, consider the 
discrete-time continuous-value sinusoidal signal x[k] given in Eq. (1.7). We 
can convert this into a discrete-value signal using the following quantization 
operation, assuming the amplitude to be A = 3: 


—1 if-—3 < x[k] < —1 
X[k] = 0 if—1 < x[k]< +1 (1.12) 
+1 if+1 < x[k] < +3 


Thus, we see that X[k] is a discrete-time discrete-value signal and it takes only 
one of the three values {—1, 0, 1} at any time instant kT; (or, time index k). 
The corresponding signal is illustrated in Fig. 1.10. 

In general, continuous-time continuous-value signals are also known as ana- 
log signals and discrete-time discrete-value signals are known as digital signals. 


§ Examine the kind of signal processing interface you will need to set-up to store your 


speech signal in a computer. 


1.2.2 Periodic and Aperiodic Signals 


A periodic signal repeats itself with some period Tp in the time domain. That is, if 
X(t) is a periodic signal, it must obey the following relation for any integer k: 


x(t +kTp) = x(t) for all t. (1.13) 


The sinusoidal signal given in Eq. (1.1) is an example of a periodic signal. Its period 
is given by Tp = 1/fp. 

A periodic signal can be completely specified by specifying its period and defining the 
signal during one period. For example, a triangular periodic signal of period 2 seconds 
can be defined by defining one period during the time interval0 < t < 2 as follows: 


t fr0 <t < +1, 


a) = - —t for+l<t < +2. (1,14) 
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§ Plot the triangular periodic signal defined in Eq. (1.14). 


The signals that are not periodic are called non-periodic or aperiodic signals. The 
exponentially decaying signal considered in Eq. (1.2) and the signal Z(t) given by 
Eq. (1.10) are examples of aperiodic signals. 


1.2.3 Deterministic and Random Signals 


Deterministic signals are the ones whose values can be predicted exactly, and there is 
no uncertainty about the value of these signals at any given time. Such signals can be 
usually described by mathematical expressions. For example, the sinusoidal signal 
given by Eq. (1.1), the exponentially decaying signal given by Eq. (1.2) and the 
triangular periodic signal given by Eq. (1.14) are examples of deterministic signals. 

A random signal is one whose values cannot be predicted exactly because of some 
uncertainty caused by physical phenomena. We may not be able to exactly describe 
random signals using mathematical expressions. Some examples of random signals 
are as follows. 


e The noise that is picked up by a radio/TV receiver. 

e The output of a coin-tossing experiment. 

e The signal received by a mobile phone is random due to the random 
(and time-varying) nature of the channel. 

e The number of passengers arriving at any given time at an international 
airport. 


1.2.4 Real and Complex Signals 


A real signal is one whose values are real numbers. All the signals we considered so 
far in this chapter are real signals. 

A complex signal is one whose values are complex numbers. A typical example is 
the complex sinusoid defined as, 


x(t) = Aei Cr fot+9) (1.15) 


where j = /—1. The parameters A, fo, and ¢ denote the amplitude, frequency 
and phase, respectively, of the complex sinusoid. Using the Euler’s identity 


ei = cos(z) + j sin(z), (1.16) 


we can express the complex sinusoid in Eq. (1.15) in the form 


x(t) = Acos(2z fot + p) + jA sin(27 fot + @). (1.17) 
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On the other hand, using this identity, we can express real sinusoids as? 


ei OCxfott+d) 4 eT™iCrfot+o) 
A cos(27 fot +) = A 5 , (1.18) 
oi Ox foltd) — e-i Qn foto) 
Asin(2z fot + ġ) = A T ; (1.19) 
J 
Noting that e~J@*for+#) — eile foy'-$] and 1/j = —j = e7/*/?, we can 


conclude the following: 


§ A real cos sinusoid of amplitude A, frequency fo and phase ġ can be obtained by sum- 
ming two complex sinusoids of amplitudes {A /2, A/2}, frequencies { fo, — fo} and phases 
{b, —p}. For the same amplitudes and frequencies, we get a real Sin sinusoid if the phases 
are {p — n /2, —p + 7/2}. Thus, complex sinusoids act as building blocks for real signals. 


This means that real signals can be constructed by combining complex sinusoids. 


Different views of the complex sinusoid in Eq. (1.15) with ø = 0 is shown in 
Fig. 1.11. In the figure, a(t) is the instantaneous magnitude, and 6 (t) is the instan- 
taneous angle/phase of the complex sinusoid. The real component, A cos(2z fot), 
is the projection of the complex sinusoid onto the real axis and the imaginary com- 
ponent, A sin(2z fot), is the projection of the complex sinusoid onto the imaginary 
axis in a complex plane. This is illustrated in the 3D view of the complex sinusoid 
(phasor) in the figure. 


1.3 Typical Real World Biomedical Signals 


There are hundreds or thousands of types of biomedical signals, that one can think 
of, from a living organism. In this section, however, some of the most commonly 


referred types of biomedical signals are briefly described. 


1.3.1 Electroencephalogram (EEG) 


It is a recording of the electrical activity of the brain by placing electrodes on the 
scalp. The recorded waveforms reflect the cortical electrical activity generated by the 
firing of brain cells neurons. The amplitude of EEG activities are quite small, mea- 
sured in microvolts to millivolts. The main frequency contents of EEG waveforms 
are Delta (0.5—4 Hz), Theta (4-8 Hz), Alpha (8-12 Hz), and Beta (12-35 Hz). 


[e@-e~/?] 
2j 


[ei++e-?] 
2 


3. Note: cos(z) = and sin(z) = 
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Imix(1)} 


“rjo al T a) 
h h 
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Figure 1.11. Different views of the phasor Ae/27/0!, 


Delta waves: It tends to be the highest in amplitude and the lowest in frequency. 
It is the dominant rhythm in infants and in stages 3 and 4 of sleep in adults. 
It may occur focally with subcortical lesions and in general distribution with dif- 
fuse lesions, metabolic encephalopathy hydrocephalus or deep midline lesions. It is 
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Figure 1.12. EEG delta wave. 
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Figure 1.13. EEG theta wave. 
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Figure 1.14. EEG alpha wave. 


usually most prominent frontally in adults and posteriorly in children. A delta wave 
segment for four seconds is shown in Fig. 2.1. 

Theta waves: It is classified as “slow” EEG activity. It is perfectly normal in chil- 
dren and in sleep but abnormal in awake adults. It can be seen as a manifestation 
of focal subcortical lesions. It can also be seen in generalized distribution in diffuse 
disorders such as metabolic encephalopathy or some instances of hydrocephalus. 
In Fig. 1.13, a small segment of a typical theta wave is provided. 

Alpha waves: Figure 1.14 illustrates a segment of alpha EEG waves. Is usually best 
seen in the posterior regions of the head on each side, being higher in amplitude on 
the dominant side. It appears when closing the eyes and relaxing, and disappears 
when opening the eyes or alerting by any mechanism (thinking, calculating). It is 
the major rhythm seen in normal relaxed adults. It is present during most of life 
especially during teenage years and after. 

Beta waves: As you may see from Fig. 1.15, it is the “fast” EEG activity. It has 
higher frequency and lower amplitude. It is usually seen on both sides of the brain in 
symmetrical distribution and is most evident frontally. It may be absent or reduced 
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Figure 1.15. EEG beta wave. 
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Figure 1.16. ECG signal. 


in areas of cortical damage. It is generally regarded as a normal rhythm. It is the 
dominant rhythm in patients who are alert or anxious or have their eyes open. 


1.3.2 Electrocardiogram (ECG) 


It is the recording of the electrical activities of the heart based on skin surface elec- 
trode measurements. An example of a typical ECG waveform for a normal adult is 
shown in Fig. 1.16. ECG offers a low-cost non-invasive investigation of the heart, 
commonly used for the detection of heart arrhythmia and conduction disturbances. 
It can also be used to to investigate the heart morphology to discover hypertrophy 
or myocardial infraction. 


1.3.3 Electrooculogram (EOG) 


It is a technique for measuring the corneo-retinal standing potential that exists 
between the front and the back of the human eye. Primary applications are in oph- 
thalmological diagnosis and in recording eye movements. 

To measure eye movements, pairs of electrodes are typically placed either above 
and below the eye or to the left and right of the eye. If the eye moves from centre 
position towards one of the two electrodes, this electrode “sees” the positive side 
of the retina and the opposite electrode “sees” the negative side of the retina. Con- 
sequently, a potential difference occurs between the electrodes. Assuming that the 
resting potential is constant, the recorded potential is a measure of the eye’s position. 
An example of eye-blink EOGs for ten seconds long is illustrated in Fig. 1.17. 
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Figure 1.17. EOG (eye blinks) signal. 


Figure 1.18. A typical ERG signal. 


1.3.4 Electroretinogram (ERG) 


It measures the electrical responses of various cell types in the retina, including the 
photo receptors, inner retinal cells, and the ganglion cells. Electrodes are placed on 
the surface of the cornea or on the skin beneath the eye to measure retinal responses. 
Retinal pigment epithelium (RPE) responses are measured with an EOG test with 
skin-contact electrodes placed near the canthi. During a recording, the patient’s eyes 
are exposed to standardized stimuli and the resulting signal is displayed showing 
the time course of the signal’s amplitude (voltage). Signals are very small, and their 
amplitudes are in the range of typically nano volts to micro volts. The ERG is com- 
posed of electrical potentials contributed by different cell types within the retina, 
and the stimulus conditions (flash or pattern stimulus, whether a background light 
is present, and the colours of the stimulus and background) can elicit stronger 
response from certain components. A typical ERG signal is shown in Fig. 1.18. 


1.3.5 Electromyogram (EMG) 


This is an electrodiagnostic technique for evaluating and recording the electrical 
activity produced by skeletal muscles. An EMG detects the electric potential gen- 
erated by muscle cells when these cells are electrically or neurologically stimulated. 
These signals can be analysed to detect medical abnormalities, activation level, or 
recruitment order, or to analyse the biomechanics of human or animal movements. 
In computer science, EMG is also used as middle-ware in gesture recognition 
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Figure 1.19. A typical EMG signal segment. 


towards allowing the input of physical action to a computer as a form of human- 
computer interaction. Figure 1.19 shows an illustration of a typical EMG signal. 

As mentioned earlier, the most important characteristics of a signal are the power, 
frequency and phase. In the next chapter, the definition of power and energy of 
signals and the ways to estimate them are briefly described. 


1.4 Concluding Remarks 


The following points can be deduced from the discussions we have had in this 
chapter. 


e Definitions of some of the most common types of signals were provided with 
illustrations. 

Ways of classifying signals were provided. 

Most of the practical real-world signals are aperiodic and random in nature. 
Complex sinusoids act as building blocks in the study of real signals. 


Examples of typical biomedical signals were provided. 


DOT: 10.1561/9781680839791.ch2 


Power and Energy 


According to physics, power is defined as the rate of doing work, it is the work 
done in unit time. Energy, on the other hand, is a quantitative property that must 
be transferred to an object in order for it to perform some work. Hence, energy is 
defined as the strength to do any kind of physical activity. Thus, energy is the ability 


to do work. Here, in this chapter, the following points are discussed in detail: 


e Definition and meaning of energy and power for signals, and computations 
of these quantities for typical examples of signals. 
e Detailed understanding of sinusoidal (real and complex) signals. 


2.1 Power and Energy of Signals 


Consider the simple electric circuit shown in Fig. 2.1 below. Here a resistance of 
R Q is connected to a voltage source x(t). A current flows through the circuit, 
which makes the resistance to dissipate some power in the form of heat. 

Here, x(t) is the voltage source connected to a resistor of resistance R Q. Then, 
we know that, the instantaneous power (p(t)) delivered to the resistor is given by 
p(t)= HOP If R = 1 Q, we get the instantaneous power of the signal x(t) at time 
t as, 


p(t) = O. (2.1) 
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x(t) RO 


Figure 2.1. A resistor connected to a voltage source. 


For real-valued signals, the instantaneous power is given by x? (t). However, in 
Eq. (2.1), we use |x(t)|? (instead of x?(t)) so as to account for complex-valued 
signals. Since power is energy per unit time, we get the energy (e) of the signal x(t) 
over the time interval tyi < t < t2 as, 


t2 th 
enon = f p(t)dt = f |x(t)|?dt. (2.2) 
ti ti 


Consequently, we get the average power of the signal x(t) over the time interval 
tl <t <tas 


— Strat 1 t2 2 
Pt>n == cre |x(t)| dt. (2.3) 
to-th h-t Ja 


Extending the definition in Eq. (2.2) to the complete time interval 
—0oo < t < 00, we can get the total energy (or, energy) of the signal x(t) as, 


T/2 


e= lim lx (t)|7dt. (2.4) 
T3 0 J_T/2 


Here, for the sake of convenience and without losing generality, we have used t; = 
-7 and t2 = $, where T denotes an arbitrary time interval. Similarly, we can get 
the average power (or, power) of the signal x(t) as 


T= œ 


1 T/2 
p= lim = : xOldt. (2.5) 
=T 
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§ Ifa signal x(t) is periodic with period Tp, show that its power can be computed using 


one of the following expressions, 


Tp 
T; o’ Ix(t)|(?dt, or 


P=)r Ti KOl dt, or (2.6) 


1 to+T, 2 
T; K P \x(t)| dt. 


and it is equivalent to Eq. (2.5). Here, to is any arbitrary time point. Show also that its 


energy is infinity. 
§ Examine the power and energy of the signals given in Eqs. (1.1)-(1.6). 


2.2 Energy Signals and Power Signals 


Signals are also classified according to their energy and power. Signals with non-zero 
finite power are known as power signals. Similarly, signals with non-zero finite energy 
are known as energy signals. 


§ Show that the energy of a power signal should be infinity, and the power of an energy 
signal should be zero. 

§ Can a signal be simultaneously a power signal and energy signal? 

§ Classify the signals given in Eqs. (1.1)-(1.6) into energy or power signals. 


We shall now use the expressions for the power and energy defined earlier to 
determine the power and energy of real and complex sinusoidal signals. 


2.21 Single Real Sinusoid 


Let us first consider the case of a real sinusoid given by, 
x(t) = Acos(2z fot + Ø). 


where, A, fo, and ¢, are the amplitude, frequency and phase, respectively of the 
sinusoid. We get the instantaneous power as, 


p(t) = |x)? = A? cos? (2r fot + $), 


A2 
= [1 + cos(4z fot + 2¢)], (2.7) 
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as cos*(z) = 4 ae + cos(2z)]. Without loss of generality, we can take the time 
interval T in Eas. (2.4) and (2.5) as T = mT where m is an integer and Ty = T 
is the period of the sinusoid. Since cos(4 fot + 2¢) is periodic with period To/2, 
and the positive and negative half-cycles of cos(4z fot + 2) have equal areas, 
we get 


T/2 
f cos(4z fot + 2¢)dt = 0. (2.8) 
-T/2 


To understand Eq. (2.8), let T = mTo. Then, we get (since foTo = 1) 


[- cos(4z fot + 2¢)dt = sin( fot +20) f 

-T/2 4r fo _mTo/2 
= asin(2a fomTo + 2¢) — asin(—2z fomTo + 2¢), 
=asin2Qmaz + 2¢ġ) + a sin(2mr — 29), 
= asin(2¢) — a sin(2¢) = 0, 

where a = ihe This can also be easily seen (intuitively) by the fact that the 


areas over the positive half-cycles and negative half-cycles are equal for the function 
cos(4z fot + 2) over an interval that is an integer multiple of its period. 

Therefore, we get the power and energy of a real sinusoid of amplitude A (any 
non-zero frequency and any phase) as 


1 T/2 A2 A2 
p= lim = —dt = — (2.9) 
Too T J-rp2 2 2 
T/2 A2 
e= lim —dt =o. (2.10) 
T— 0 T/2 2 


§ Show that the power and energy of the signal x(t) = A sin(2a fot + $) are also given 
by Eqs. (2.9) and (2.10). 


2.2.2 Single Complex Sinusoid 


Next, let us consider the case of a complex sinusoid given by 
x(t) = Ae Cn forte), oma 
We get the instantaneous power as 


p(t) = kA = A* (2.12) 
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as |e) zj? = cos? (z) + sin? (z) = 1. Therefore, we get the power and energy of a 
complex sinusoid of amplitude A (any frequency and any phase) as 


1 T/2 
p= lim =S A?dt = A? (2.13) 
Too T., -T/2 
T/2 
e= lim A?dt = 00. (2.14) 
T= œ —T/2 


2.2.3 Sum of Complex Sinusoids 
Let us consider the signal obtained by summing two complex sinusoids as, 
x(t) = Aye CAHAD) 4 Arnel CTRA, (2.15) 


where {A1, A2}, {f1, fo} and {¢1, %2} represent the amplitudes, frequencies 
and phases, respectively, of the two sinusoids. Then, we get the instantaneous 
power as,! 


PO = KOP =xOx"O 
= | Ayei@rhittor) 4 Apel Ventre | 


x [Are Jerre) + Age! Ganra | 


=A? +AA? [eert fa)t+1-$2) 4 pi Qn(fi- i+ |+ 42 


= A? + 2A Ap cos(2r (fi — fo)t + 61 — p2) + AB. (2.16) 


Note that cos(2z (fi — f2)t + ¢1 — $2) is periodic with period To = eG 
Therefore, by choosing T = mTpo (m being an integer), we get, 


T/2 
i. cos(2z (fi — f2)t + b1 — d2)dt = 0. (2.17) 


Therefore, we get the power of the sum of two complex sinusoids of different frequencies 
{fi, f2} and amplitudes {A,, A2} (and any phase) as, 


1 T/2 
p= lim z z A?°dt = A? + A3. (2.18) 


As before, the corresponding energy of x (t) is infinity. 


1. Here, x* (t) denotes complex conjugate of x(t). 
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§ Examine the power of the sum of two complex sinusoids given in Eq. (2.15) in the case 
where fi = fo. Assume that A, # Az and hpi Æ ¢2. 

§ Express a real sinusoid of frequency fo as the sum of two complex sinusoids with frequencies 
fo and — fo. Then, using Eq. (2.16), show that the power of a real sinusoid of amplitude 
A is equal to x 


We can easily generalize the above results to determine the power of a signal consist- 
ing of the sum of M complex sinusoids with different frequencies. Let the signal be 
given by, 


M 
x(t) = > Aji Orit), (2.19) 


i=l 


where Aj, fi and ¢; represent the amplitude, frequency and phase, respectively, of 
the i” sinusoid (fori = 1,2,..., M). Then, we get the power of x(t) as, 


M 
p=) AP =A +A +--+ Ay. (2.20) 
i=l 


2.2.4 Sum of Real Sinusoids 


Consider the signal obtained by summing two real sinusoids as 
x(t) = Aj cos(27 fit + $1) + A2 cos(2z fot + Q2), (2.21) 


where {A1, A2}, { f1, fo} and {¢ġ1, $2} represent the amplitudes, frequencies and 
phases, respectively, of the two sinusoids, with fı # f2. Using Euler’s identity, we 
can write x (t) as, 


x(t) = ajel CTRA) y ajed CMA, 
+ aged Cr frtt+92) + azel 2a(—fr)t-$2) (2.22) 


where a] = Aj/2 and az = A2/2. Since fi, — fi, fo and — fo are distinct 
frequencies, we can use Eq. (2.20) to obtain the power of x(t). Thus, we get the 
power of the sum of two real sinusoids of different frequencies { f1, f2} and amplitudes 
{A 1, A2} (and any phase) as, 
2 2 
A 
ais 


5 a (2.23) 


p= +a? +a? +a? = 


As before, we can generalize the above results to determine the power of a signal 
consisting of the sum of M real sinusoids with different frequencies. Let the signal 
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be given by, 


M 
x(t) = > Aj cos(2x fit + $i) (2.24) 


i=l 


where A;, fi and ¢j represent the amplitude, frequency and phase, respectively, of 
the i” sinusoid (fori = 1,2,..., M). Then, we get the power of x(t) as, 


= Co eg (2.25) 
i=l 


§ Derive Eq. (2.23) without using Euler’ identity? 


An important step in the study and/or analysis of signals is to express the signals 
in the form of sum of many complex sinusoids and to identify which frequencies 
have dominant contribution. This task is called the spectrum estimation. The funda- 
mental tool that facilitates spectrum estimation is Fourier transform and its variants. 
Fourier series — the variant of Fourier transform when applied to periodic signals is 
discussed in the next chapter. 


2.3 Concluding Remarks 


Based on the discussions above, the following conclusions can be derived: 


© The power of a signal consisting of a sum of sinusoids (real or complex) is given 
by the sum of the powers of the individual sinusoids, if the frequencies of 
these sinusoids are different. 

e The phases of the sinusoids have no effect on the power if the frequencies of 
the sinusoids are different. If the frequencies of any two sinusoids are equal, 
then their phases will have an effect on the total power [11]. 


N 


For this, first show that the instantaneous power of x(t) can be obtained as, 


1 + cos(4z fit + 2ġ1) 1 + cos(4z fot + 2¢2) 
pO = Aj z + AZ g 


+ Ay Az [ cos(2n(fi + ft + $1) + cosa (fi = fot + b2)], (2.26) 


where A = ¢ + ¢2 and do = ġı — 2. In doing this derivation, the following identities will be useful: 
2 cos(A) cos(B) = cos(A + B) + cos(A — B) and 2 sin(A) cos(B) = sin(A + B) + sin(A — B). Then, 
using an appropriate choice of integration interval T, argue that the integration of all the ‘cos(-)’ terms in 
Eq. (2.26) will become zero. 
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Exercises 


2.1. The delta function 6(t) in Fig. P2.1 is a “generalized” function and is fre- 


quently used in signal processing. Find its energy. 


âli) Area = | 


l 
© l 
0 (s) 0 Ws) 


Figure P2.1. Delta function. 


2.2. The process of modulation shown in Fig. P2.2 below is frequently used 


2.3. 


2.4. 


to “up convert” the frequency of a signal to a higher value so that it can 
be more efficiently transmitted over a channel. Are the energy of x(t) and 
y(t) the same? 


x(t) M(t) 


jario 


e 


Figure P2.2. Modulation scheme. 


Convert the following complex numbers into polar form, that is, in the 

form of s = pe/®. Here, p is the magnitude of s and ¢ is the phase of s. 

(a) 5) =4+ j5 

(b) s2(t) = a(t) + jb@) 

(c) s3(t) = 10 cos (207t + z) 

Convert the following complex numbers into rectangular form, that is, in 

the form of s = x + jy. Here, x is the real part of s and y is the imaginary 

part of s. 

(a) s1 = 2e/8 

(b) s2 = 2kes™*/3 

(c) 53(t) =R [102e/20r+5)], where R denotes the real part of a complex 
number. 
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2.5. Determine whether or not each of the following signals is periodic. If the 
signal is periodic, determine its fundamental period. 
(a) x1(t) = cos(4t) + sin(6r) 
(b) x2(t) = cost + sin (vz) 
(9 x3(t) = efl(@/2)t- 11 

2.6. Determine whether the following signals are energy signals, power signals 
or neither. 
(a) x1(t) =e-“u(t), where a > 0 and u(t) is the unit step function 
(b) x2(t) = tw(t). 
(c) x3(t) = acos(wot + $) 
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Chapter 3 


Fourier Series 


The study of signals and systems using sinusoidal representations is known as 
Fourier analysis (named after the French mathematician Jean Baptiste Joseph 
Fourier, who developed Fourier series). In this chapter, we discuss the representa- 
tion of periodic signals in terms of sinusoids. This lays the foundation for spectrum 
estimation, which is one of the most important topics in the study and applications 
of signals and systems. Since each sinusoid corresponds to a single frequency, the 
representation of signals using sinusoids leads us to frequency-domain understanding 
and interpretation of signals. 

Frequency-domain representation of signals is very necessary as well as useful in 
practical applications and theoretical studies. For example, we should know what 
are the frequencies present in a signal, before we can design a communication sys- 
tem to reliably transmit this signal. An important advantage of frequency-domain 
representation is that it is often easy to see certain signal characteristics when we 
examine the signal in this domain, compared to the time-domain. Figure 3.1 illus- 
trates this for a signal consisting of sinusoids and noise. 

In Fig. 3.1, the signal, x(t), is synthesized by combining three sinusoids of dif- 
ferent amplitudes and frequencies along with white Gaussian noise’ as shown in 


1. Will be described in a later chapter of this book. 
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Figure 3.1. Time plot of sum of three real sinusoids (at frequencies 20 Hz, 30 Hz, 50 Hz) 
and noise (top) and its frequency spectrum (bottom) in the frequency domain. 


the following equation: 
x(t) = A, sin(2a fit) + Az sin(2z fat) + A3 sin(2z fst) + n(t), (3.1) 


where A1, A2, A3 are respectively 4, 2.5 and 1.5. The corresponding three frequen- 
cies, f1, f2, f3 are 20Hz, 30Hz and 50Hz. n(t) in Eq. (3.1) is the white Gaussian 
noise added to the sinusoids. The signal (top; time domain) and its frequency spec- 
trum’ (bottom; frequency domain) are shown in Fig. 3.1. It can be observed that 
while it is not possible to infer either the number of sinusoids or their frequen- 
cies from the time-domain plot, the frequency-domain spectrum clearly conveys 
this information. The relative amplitudes of the sinusoids are also clearly visible 
from the frequency domain spectrum. The background noise spectrum also can be 
clearly seen in the frequency domain and it spans the complete frequency range. 
This illustration clearly explains the importance of Fourier representation of signals. 
In this chapter, the following points will be discussed in detail. 


e The role of sinusoids as basic building block for synthesizing signals. 
e Representation of periodic signals using sinusoids (real or complex), leading 
to the concept of frequency-domain representation of signals. 


2. Distribution of frequencies in the signal. 
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© The definition and interpretation of spectrum, and interpreting signals based 
on their spectra. 

© Various properties of Fourier series representation, and their use in practice. 

e Limitations of Fourier series representation. 


3.1 Introduction to Fourier Series 


Consider the vector 7 shown in Fig. 3.2. It connects the origin O (0, 0) to the point 
P(x, y), in the X —Y plane. Here, x and y are the X-coordinate and Y-coordinate 
of the point P. The vector 7 can be expressed as, 


f =X: Xu +Y: Yu, (3.2) 


where x, and y, are unit vectors (i.e., vectors of length 1.0) along X and Y axes, 
respectively. In other words, given any vector F connecting the origin O (0, 0) to 
a point ‘P(x, yY in the X — Y plane, we can express this vector as a sum of scaled 
unit vectors along the X and Y axes; the scale factors (i.e., x and y) can be obtained 
by determining the components of r along X and Y axes. Thus, we are able to 
represent all vectors in the X — Y plane in terms of the two unit vectors Xu and Yu. 


§ A special feature of this representation is that the vectors Xy and Yu, which we have chosen 
as fundamental components, are perpendicular (or, orthogonal) to each other. 


This representation is convenient because manipulation and interpretation of vec- 
tors can now be done in terms of the standard vectors Xy and Yu, which are easy to handle 
and interpret. 

Fourier series does a representation of the type explained above for the case of 
periodic signals. In place of the unit vectors x, and y,, Fourier series uses complex 


F. X 


Figure 3.2. Vector r in rectangular coordinates representation. 
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sinusoids as the basic/fundamental signals for representing periodic signals.’ Since 
a complex sinusoid e/" is associated with a specific frequency Qp (27 fp; fp is 
the cyclic frequency of the sinusoid), we can generate any arbitrary signal by adding 
many complex sinusoids of different frequencies, with appropriate amplitude and 
phase for each sinusoid. In particular, we note the following: 


§ For a periodic signal x(t) with period Ty (or, frequency fp = 1/Tp), the complex 


sinusoids that are required to represent x(t) are only those at the frequencies kfp for 
k= Q El E2 


3.2 Why Fourier Series? 


It is good for us to ask ourselves the following questions: 


§ Why do we want to express signals using Fourier series? 
§ How does the knowledge of Fourier series benefit us in practical applications involving 


signals and systems? 


Let us consider the case of having to transmit a signal x(t) (e.g., speech, video, 
data files, outputs of some sensors, etc.,) from one place to another. We expect the 
transmission medium (e.g., telephone cables, optical fiber cables, wireless medium, 
etc.,) to deliver the signal faithfully to the receiver. We can not check this by simply 
looking at the time-domain signal x(t). One easy way to check this is to examine 
the frequencies present in x(t), which can be done by using a tool such as Fourier 
series. By examining the values of the Fourier series coefficients Xg, we can know 
the maximum frequency (with non-negligible amplitude) present in the signal. Let 
the maximum frequency be 100 KHz (kilo Hertz) in a particular application. Then, 
we should look for a suitable transmission medium that will not attenuate frequencies up 
to 100 KHz. Thus, we can ensure that the chosen transmission medium faithfully 
transports the signal to the destination. 

This example shows that the knowledge of frequency-domain representation of sig- 
nals can be very helpful in practical applications. Even though most of the useful 


3. We will study later that complex sinusoids of different frequencies are orthogonal to each other. Mathemat- 
ically, this means the following: 


I. Arel Qt htt) Arei CTR +A) dy =0 if fi # f. (3.3) 


—0o 
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practical signals are non-periodic in nature, the study of periodic signals forms the 
foundation for the study of non-periodic signals. 


3.3 Fourier Series: Definition and Interpretation 


Let x(t) be a periodic signal with period Tp (or, frequency fp = 1/Tp). Then, 
based on the discussion at the end of Section 3.1, we get the Fourier series repre- 
sentation for x(t) as, 


(oe) 
x(Qth= >) XpelbOrt, (3.4) 
k=- 
=... + X_pe7 F228 + X_ je Ir! + Xo 
+ Xjei rt 4 Xoe rt p... 


where, X;s are the Fourier coefficients and kQ ps are harmonics of the fundamen- 
tal frequency Qp. Comparing Eq. (3.4) with Eq. (3.2), we find that the complex 
sinusoids e/*®! take the place of the unit vectors x, and Yu, and the coefficients 
Xs take the place of the scale factors x and y. 

We have the following remarks on the Fourier series representation given in 


Eq. (3.4). 


© Complex sinusoids are used as component signals to express the given periodic 
signal x(t). 

© Frequencies of the complex sinusoids are given by kQy or 2akfp where fp = 
1/Tp and k = 0, +1, +2,.... 

© Qp, is called the fundamental frequency (Note: kQ p with k = 1) and kQ, is 
called the k"" harmonic frequency. 

e For all periodic signals with a given period Tp, we can state the following: 


— The complex sinusoids that constitute the Fourier series are the same for all the 
signals and are given by eFkQv! fork = 0, +1, +2,.... 
— But the set of coefficients {Xx} will be different for each signal. 


e The coefficients X, are obtained as follows: Consider, 


Tp A Tp = i ‘ 
J x (the ir" dt — f | » ed oe IMQot dt 
JO 0 


k=—0o 


CO 


Tp Fi 
=>), X f ei km Qpt dy, (3.5) 
0 


k=—o0o 
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where m is an arbitrary integer. Since Q Tp = 2a fpTp = 27, and e"? = 
1 for integer n, we get 


Tp j2a(k—m) _ ‘ 
0 JQp(k —m) Tp if k=m. 


Substituting Eq. (3.6) in Eq. (3.5), we get 


= imQ 1 [Tr na 
| xe "dt = TpXm > Xm = F) x(the 7i”! dt. 
. Tp Jo 
(3.7) 
This implies that 
i ikQ 
Xk = zj x(t)e odt. (3.8) 
Tp Jo 


The interval of integration should be one period and this period can be taken 
to be anywhere on the time axis. That is either [0, Tp], or [—Tp/2, Tp/2], 
etc. In general, it can be taken as [tp, tp + Tp] where tp is any arbitrary real 
number. 

e Because Xx is a complex number, we can express it as 


Xy = |Xelel™, (3.9) 


where |X;| = ,/X 3 + X? is the magnitude of the complex quantity and 
Ok = tan! (34) is the phase of the complex quantity. Here, Xg = Xk,r + 
JXx,i with Xx, and Xķ,i being the real and imaginary parts, respectively, of 
Xx. Thus, |X| and Ox give the magnitude and phase, respectively, of the complex 
IKO at frequency kQy. 


© The coefficient Xx gives the strength (i.e., amplitude and phase) of the k” 
JQ pt 


sinusoid Xe 


harmonic e in the given signal x(t). 


§ The set of coefficients {Xx} gives the frequency composition of the given signal. That 
is, by observing the values of Xg, we can know which all frequencies (or, complex 
sinusoids) are required to construct the signal x(t) and what is the amplitude and 


phase of each sinusoid. 
In other words, we can say that 


§ Fourier series gives a frequency-domain representation of periodic signals. 
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In summary, if x(t) is periodic and satisfies the Dirichlet conditions,‘ it can be 
represented in a Fourier series as in Eq. (3.4), where the coefficients Xg are specified 
by Eq. (3.8). So, the frequency analysis of continuous-time periodic signals are 
summarized below: 


e The synthesis equation: 


CO 
s= > Ken. (3.10) 
k=—0o 
e The analysis equation: 
a a ikQ 
X= = x(t)e JP dt. (3.11) 
Ty Jo 


e Magnitude spectrum of x(t): It is the plot? of |X| vs k. That is, it is the 
distribution of the amplitudes of the sinusoids as a function of the frequency. 
Note that the index k actually is an indicator of the frequency kQy. 

e Phase spectrum of x(t): It is the plot of O vs k (i.¢., distribution of phase 
vs frequency). 


© Power spectrum of x(t): Since |X zl? is the power of the k’ h harmonic,° the 


plot of |X;|* vs k gives the power spectrum (i.e., distribution of power vs 
frequency) of x(t). 

e Power of x(t): Since the complex sinusoids that constitute the signal x (t) are 
at different frequencies (i.e., KQ,, k = 0, £1, +2, ...), we get the power of 
x(t) as’ 


p= >) IX. (3.12) 


4. Dirichlet conditions for Fourier series: 


e x(t) must be absolutely integrable over a period, and 
e x(t) must have a finite number of exterma in any given time interval, i.e., there must be a finite number 
of maxima and minima in the interval. 


5. The term ‘spectrum’ is usually used to refer to the distribution of some quantity as a function of frequency. 


6. Recall from Chapter 2 (see Section 2.2.2) that the power of a complex sinusoid is equal to the magnitude 
square of its amplitude. 


7. Recall from Chapter 2 (see Section 2.2.3) that the power of a signal consisting of a sum of sinusoids is equal 
to the sum of the powers of the individual sinusoids, if the frequencies of the sinusoids are different. 
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Therefore, we get (using the definition of power in Eq. (2.5) of Chapter 2) 


TE ee 2 < 2 
p= =f Pat = Y XÊ. 6.13) 
F; Jnn »> 


k=—00 


Eq. (3.13) is known as Parsevals Theorem for periodic signals. That is, we 


i % 5 ‘ 1 Tp/2 2 
can use either time-domain expression (7 J T,/2 |x(t)|“dt) or frequency- 


domain expression (es [Xx 1?) for computing the power of a (periodic) 
signal, depending upon which is easier to use. 


§ Let x(t) and y(t) be periodic signals with periods Ty and Ty, respectively and 
z(t) = x(t) + y(t). Examine if z(t) is periodic and if it is periodic, what is its period. 

§ If x(t) is periodic with period Ty, argue that the Fourier series representation given in 
Eq. (3.4) cant contain a complex sinusoid at frequency that is not an integer multiple 


of 1/Ty. 


3.4 Properties of Fourier Series 


We shall now briefly look at some of the important properties of Fourier series (FS). 
Knowing these properties will make it easy for us i) to evaluate FS of complicated 
signals, and ii) to predict the nature of signals based on their spectra and vice versa. 

Let x(t) and y(t) be periodic signals with period Tp and FS coefficients Xg and 
Yk, respectively. That is, 


[0.0] i CO . 
xQ= dD Xe, yt) = J, Ypei®rt 


k=—0o k=—0o 


Tp Tp 
1 -j 1 —j 
Xk = T; Jae JkOpt dt, Yk = T; J ye FkQpt gt, 


3.41 Linearity 
Let us construct a signal z(t) as linear combination of x(t) and y(t). That is, 
z(t) = ax(t) + y(t), (3.14) 


where a and p are two scalars (real or complex). Clearly, z(t) is also periodic with 
period Tp. Then, how are the FS coefficients, Zg, of z(t) related to that of x(t) 
and y(t)? 
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By the definition of FS, we get 


i i /kQ. 
Zk = = z(t)e J"? dt 
Ty Jo 


Tp , 
7 | " Lax(t) + By(t)] edt 
To Jo 


1 7? KQ Lf? KO 
= ax(t)e JP! dt + -Í Bye J"? dt 
Tp 0 Tp 0 


1 ie KQ 1 f KO 
Tp 0 Tp 0 
=4aXk + PYg. (3.15) 


Thus, FS coefficients of linear combination of signals are given by the corresponding 
linear combination of the FS series coefficients of the individual signals. 


3.4.2 Time Shifting 


Let z(t) = x(t — to) where to is an arbitrary time offset.* Then, as before, we get 


1 Tp ‘KO 1 Tp xQ 
Zp = [ z(t)e JP dt = =f x(t — toe"? dt 
Tp Jo Tp Jo 
1 Tp—to kQ 
a x(uje FOrPU+O dy :u =t — to 
P Y —to 
i Tp—to i 
= Hp | ” x(uje Tr" dy 
Tp —to 
— e7 }Opto y, (3.16) 
This implies that: 
[zyl = |e x E er] I= [Xel, 61 
{Phase of Zg} = {Phase of Xg} — kQ pto. (3.18) 


Thus, shifting the signal in time-domain results in a phase change in the frequency- 
domain, while the magnitude spectrum remains unaffected. 


8. Ifto > 0, then z(t) is obtained by shifting x(t) to the right by fo on the time axis. This is also known as 
delaying x(t) by to. If to < 0, then z(t) will be left-shifted (or, advanced in time) version of x(t). 
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3.4.3 Frequency Shifting or Modulation 


Let z(t) = ef"! x(t) where m is an arbitrary integer. Then, we get 
1 Tp ; ; 
Zęk= = [erx] eit dt 
Tp Jo 


1 Tp ; 
E = x (the FEM! gt 
Tp 0 
= Xk—m. (3.19) 


As an example, letm = 10 and fp = 10 K Hz. Then, Eq. (3.19) implies that mul- 
tiplying x(t) by e/”@e results in shifting the spectrum to the right by 10m KHz 
(kilo Hertz) = 0.1 MHz (mega Hertz). This principle is used in communication 
systems for shifting a signal from one frequency range to another for transmission 
purpose. 


3.4.4 Time Reversal 


Let z(t) = x(—t), time-reversed x(t). Then, we get” 


Zk 


ak (—1)e d 
— x(—t)e P dt 
Tp Jo 


1 f-* kQ 
= -= x(u)e? "du : u = —t 
Tp Jo 


1 f° ; 1 f° 

= x(ujel*?r"du = = x(uje I} CPL dy 

Tp —Tp Tp —Tp 

=X}. (3.20) 


That is, reversing a signal in time-domain results in reversing its spectrum in frequency- 
domain. 


3.4.5 Even-Symmetric Signal 


Let x(t) be an even-symmetric signal. That is, x(—t) = x(t). Let us examine the 
Fourier series (FS) coefficients of x(t). 


9. Recall that J x(t)dt = — i x(t)dt for any given function x(t). 
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Consider X_x given by (let T = Tp/2); 


1/7 
Kp -I 7 x (thelr! dt 
Tle 


=p fot 
= = x(—u)e FRO" dy : u = —t 
Tp JF 


T 
= -I x(uje Jk?" dy > x(—u) = x(u) 
Tp Jf 


This implies that: 
\X_glei -k = |X pet. (3.22) 


That is, the phase and magnitude spectra of an even-symmetric signal are even- 
symmetric. Thus, we have, 


|X_—x| = |X«xl, and Ok = Ok. (3.23) 
3.4.6 Odd-Symmetric Signal 


Let x(t) be an odd-symmetric signal. That is, x(—t) = —x (t). Then, proceeding 
as above, we get, 


Aa ek (3.24) 
This means that, 
|X_p|es?-* = —|X;|e/% = |Xglei +7) 


That is, the magnitude spectrum of an odd-symmetric signal is even-symmetric. 


3.4.7 Real Signal 
Let x(t) bea real signal. That is, x*(t) = x(t). Then, proceeding as above, we get 
X-k = X%, (3.26) 
which implies 
|X—glel?* = |Xyle 74 


=> |X_;~| = |X;|, and 0-, = —O. (3.27) 
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That is, the magnitude spectrum of a real signal is even-symmetric and phase spec- 
trum is odd-symmetric. 
From Eqns. (3.23), (3.25) and (3.27), we can conclude the following: 


© For a real signal, irrespective of any symmetry, the magnitude spectrum is even- 
symmetric and the phase spectrum is odd-symmetric. 

© The phase spectrum of an even-symmetric real signal is 0 or +n for all frequencies. 

That is, the FS coefficients Xg are purely real. 

E.g. x(t) = Aj cos(100zt) + A2 cos(3007t) + A3 cos(1000zt) where 

A1, Az and A3 are real numbers. 

The phase spectrum of an odd-symmetric real signal is odd-symmetric and the 

phase values are given by +r /2. That is, the FS coefficients X are purely imag- 

inary. 

E.g. x(t) = Ajsin(100zt) + Azsin(300zt) + A3 sin(1000zt) where 

A1, Az and A3 are real numbers. 


3.5 Real Fourier Series 


Let x(t) be a real periodic signal.” Then, using Eq. (3.4), write its Fourier series as, 


[0,0] 
x(t) = >, Xpert =... 4 Xe Lrt 4 X jeit 


k=—00 
+Xo + Xie r 4 Xert 4... 


= Xo + [X-1e 10! + Xie ] 
+ [Ke + xa] (3.28) 
Since X-k = X% as x(t) is real, we get 
X_pe™ iO es XpetkOvt = oe + XpetkOvt 


= 2. Real [xxe] 


= 2Xķk r cos(kQpt) — 2X; j sin(kQpt), (3.29) 


10. The material in Section 3.5 helps us to understand how the Fourier series simplifies when we consider only 
real signals. 


Real Fourier Series 39 


where Xj, and Xç, are the real and imaginary parts, respectively, of Xx (i.e., Xg = 
Xk,r + jXx,i). Substituting Eq. (3.29) in Eq. (3.28), we get 


x(t) = Xo + 2[X1,- cos(Qpt) — X1,; sin(Qpr)| 
+2[X2,- cos(2Qpt) — X2,i sin(2Qpt)| +--- 


00 oe) 


= Xo +20 Xj, coskQpt) — 2 X` Xj, sin(kQpr) 
k=1 k=1 


oo [0.0] 
= ao + È ax cos(kQpt) + È be sin(kQpt) (3.30) 
k=] k=1 


where the coefficients ag, ag and by for k = 1,2,..., 00 are given by (let T = 
Tp/2) 


l T 
ao = Xo = =I _x(t)dt (3.31) 
Pdi 
2 T 
ak = 2Xk, r = — Real f x(the Ldt 
Tp -f 
> pf 
>s | x(t) cos(kQpt)dt (3.32) 
Tp J-7 


=9 T 
by = —2Xk, i = —Imag / sine tea 
> T l f 


p 
2 f 

= =J x(t) sin(kQpt)dt. (3.33) 
Tp J-7 


Thus, Egns. (3.30)-(3.33) shows that a real signal can be represented using a real FS 
where the basic signals are real sinusoids rather than complex sinusoids, and the FS 
coefficients {ag, ak, bk} are real scalars. 

Let us consider the following special cases: 


e x(t) is Real and Even-Symmetric: Then, it is easy to show that bg = O for 
all k. Therefore, we get from Eq. (3.30) 


x(t) = ao + >. ag cos(kQyt). (3.34) 
k=1 
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e x(t) is Real and Odd-Symmetric: Then, it is easy to show that ag = 0 and 
ax = 0 for all k. Therefore, we get from Eq. (3.30) 


x(t) = È dy sin(kQpt). (3.35) 
k=1 


3.6 Examples of Fourier Series Evaluation 


We shall now present a few examples to illustrate i) how to evaluate the 
FS coefficients, and ii) how to exploit the properties of FS while evaluating 


the FS. 
Example 1: Consider an example of a periodic square wave signal (Fig. 3.3(a)) of 


period Tp = 0.5. One period of the signal is defined as, 


1 for O<t <0.25 
aS l for 0.25 < t < 0.5. eee) 


(a) 
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Figure 3.3. Periodic signal and its Fourier spectrum. (a) the periodic signal (real), 
(b) Magnitude spectrum, and (c) Phase spectrum. 
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Note that T, = 0.5, fp = 1/Tp = 2, Qp = 2a fp = 4r . Since x(t) is zero 
during 0.25 < t < 0.5, we get the complex FS coefficients as"! 


0.5 1 0.25 


x(Ðdt = — dt =0.5. 


YS 
= 05 Jo 0.5 Jo 


1 0.5 


1 fT , - , 
x= | x(t)e™} e rtdt = x (the Ldt 
Tp Jo 0.5 Jo 


0.25 l 0.5 l 
= 2 | x(the kdt + ij x(the 4" dt 
Jo 0.25 


0.25 


=2 [ e Ih a 4+ 0=2 Bii = e (3.37) 
Jo —j4rk |o j2ak 
Therefore, we get (since eit = —1 =e7J7) 
Xo = 0.5, 
kime Kai 


We see that X—g = X;, which should be so since the signal x (t) is real. Figure 3.3 
also shows the magnitude spectrum (|X;| vs k; Fig. 3.3(b)) and phase spectrum 
(Ok vs k; Fig. 3.3(c)) of the given signal, x(t). It can be seen that the magnitude 
spectrum is symmetric and the phase spectrum is anti-symmetric. 

Example 2: Let us construct a signal y(t) (Fig. 3.4(a)) using the above signal 
x(t) as, 


y(t) = x(t + 0.125). 


Note that y(t) is obtained by shifting x (t) to the left by 0.125. It is easy to see that 
the resulting y(f) is a real even-symmetric signal with period Tp = 0.5. One period 


11. Since Xg = + Co x (the kr! dt, where ty can be anything, we should choose fg such that the resulting 
p 


expression for x(t) in the interval [to, to + Tp] is easy to integrate. 
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of y(t) is given by 


1 for —0.125 < t < +0.125 
yO) = E for +0.125 < £ < +0.375. en 
As before, we get the complex FS coefficients of y(t) as 
1 0.375 0.125 
Yo = — x(t)dt = 2 | dt =0.5 
0.5 J—0.125 J—0.125 
1 0-375 0.125 
Y = — x(the Fer! at = 2 | gerry 
0.5 J—0.125 J—0.125 
en F4rkt MP ark /2) 
= - Se (3.39) 
—j4ak —0.125 wk 
Therefore, we get (since sin(kz) = 0) 
Yo = 0.5, 


ow 
I 
|- 
Ñ 
Nn 
I 
|- 


We see that Y- = Y~ = Yx, which should be so since the signal y(t) is real and 
even-symmetric. The corresponding magnitude and phase spectrum are shown in 
Figs. 3.4(b) and 3.4(c), respectively. Here again, the magnitude spectrum is sym- 
metric. The phase spectrum, unlike in Example 1, is symmetric as the signal y(t) 
is real and symmetric. 

Example 3: Construct another signal z(t) (Fig. 3.5(a)) using the above x (t) as, 


z(t) = x(t) — 0.5. 


Note that z(t) is obtained by subtracting 0.5 from x(t) for all values of t. This 
results in pulling down the waveform by 0.5. It is easy to see that the resulting z(t) 
is a real and odd-symmetric signal with period T, = 0.5. One period of z(t) is 
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Time (Sec.) 
(b) 


ith 


orru 


0;( Radians) 


Figure 3.4. Periodic signal and its Fourier spectrum. (a) the periodic signal (real and 
even-symmetric), (b) Magnitude spectrum, and (c) Phase spectrum. 


given by, 


—0.5 for —0.25<t<0 
z(t) = (3.40) 
+0.5 for O<t <0.25. 


We get the complex FS coefficients of z(t) as, 


1 0-25 
Zo = — f x(t)dt 
0.5 —0.25 


0 0.25 
=2 l (—0.5)dt +2 f (0.5)dt = 0 
—0.25 (0) 


0.25 
Z= af x(t)e Ldt 
—0.25 


0 0.25 
=2 f (—0.5)e 7} Ttdt +2 f (0.5)e~ "tdt 
0 


—0.25 
Ea e- j4nkt 0 n e` j4nkt 0.25 E ican a 
—ja4ak —0.25 —j4rk 0 j2kr i ` 
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Time (Sec.) 


(b) 


0;.(Radians) 


Figure 3.5. Periodic signal and its Fourier spectrum. (a) the periodic 


signal (real and 


odd-symmetric), (b) Magnitude spectrum, and (c) Phase spectrum. 


Therefore, we get (since cos(z) = —1 and cos(27) = 1) 
Zo =0 
1 1 

a es ee 
Z2 = 0, Z2=0 

— _l =l 
23 = a 4-3 = -jm 
Z4 =0, Z-4=0 

al —_ |1 
Z5 = jm 7-55 -jr 


Thus, we see that Z_, = Z% 


= —Zy,, which should be so since the signal z(t) 


is real and odd-symmetric. As can be seen from Fig. 3.5, the magnitude spectrum 


(Fig. 3.5(b)) is once again symmetric and the phase spectrum (Fig. 3.5(c)) is anti- 


symmetric. Also, the even indexed (i.e., k = 0, +2, +4, ...) Fourier coefficients 


are all zeros and the corresponding phases are also zeros. 


§ Use the properties of FS to verify the above results for Yy and Zg. Isnt this a much easier 


approach? 
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3.7 Limitations of Fourier Series 


We shall now point out some limitations of Fourier series. 


3.71 Gibbs Phenomenon 


Let us define a signal x(t) as 


N 
I= >) Xe 
k=-N 


where N is a positive integer. Based on the definition of FS in Eq. (3.4), we expect 
X(t) to converge to x(t) as N — oo. Indeed, this happens if the signal x (t) is con- 
tinuous, i.e., there are no discontinuities in the signal waveform (e.g., the triangular 
periodic signal defined in Section 1.2.2). 

However, the situation is different when the signal contains discontinuities, as 
in a periodic square-wave signal as in Examples 1, 2 and 3). For such signals, as 
N — œ, X(t) converges to x(t) for all values of t except at points of disconti- 
nuities. “Overshoots” appear near the discontinuities. This is known as Gibbs phe- 
nomenon. As N — on, the height of the overshoot remains constant, while its 
width approaches zero. Thus, as N — 00, the energy in the overshoots approaches 
zero, and hence the power of x(t) approaches that of x (t). 


§ Why does Gibbs phenomenon occur? 


3.7.2 Dirichlet Conditions 


For a periodic signal x(t) to be represented by Fourier series, it must satisfy the 
following conditions (for any tọ). 


© It must be absolutely integrable over the interval [to, to + Tp]. That is, 


to+Tp 
f Ix(t)| dt < o. (3.42) 
to 


D 


e It must havea finite number of maxima and minima over the interval [to, to+ 
Tp]. 

e It must have a finite number of discontinuities, all of finite size, over the 
interval [to, to + Tp]. 


These are known as Dirichlet conditions for existence of FS. 
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So far, we have discussed the FS representation of periodic signals only. Almost 
all of the real-life signals are aperiodic in nature. How do we find the Fourier rep- 
resentation of such aperiodic signals? This is what is explained in the next chapter. 


3.8 Concluding Remarks 


We can make the following concluding remarks based on the material presented 
above. 


e Fourier series gives a frequency-domain representation of periodic signals. 
It can be used to assess the effective bandwidth of periodic signals. 

e Spectra of periodic signals are discrete-frequency in nature. 

e The properties of Fourier series can be used to simplify the effort (integration, 
computations etc.) necessary in evaluating the Fourier series coefficients. 

e For real signals, the complex Fourier series can be expressed as a real Fourier 
series where the basic/fundamental signals are real sinusoids instead of com- 
plex sinusoids. 

e For real even-symmetric or odd-symmetric signals, the Fourier series coeffi- 
cients also have certain well defined symmetry properties. These properties 
can be exploited to simplify the computations or to verify the solutions. 


Exercises 


3.1. The waveform shown in Fig. P3.1 is the periodic voltage of a signal gen- 
erator. Find the Fourier coefficients and write down the terms of the series 
through the 6th harmonic. 


Figure P3.1. 


3.2. The rectangular wave in Fig. P3.1 is modified as follows. The positive part 
of the wave now extends from 0 to 1 and the negative part from 1 to 3 s, 
and this pattern is repeated. In addition, the positive amplitude becomes 


3Q/2 and the negative amplitude — Q /2. 
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(a) 


Find the coefficients of the Fourier series. 


(b) Write down the terms of the series through the third harmonic. 


3.3. A square wave periodic signal is shown in Fig. P3.3 without an origin of 


3.4. 


3.5. 


time. 


(a) 


(b) 


(a) 
(b) 


Select a time origin to make the resulting function even, and deter- 
mine the Fourier coefficients. Choose the one period integration 
interval in such a way that the evaluation of the integrals is simplified. 
Note how the harmonic amplitudes vary with the number. 


Figure P3.3. 


For the square wave in Fig. P3.3, choose the origin of time in order 
to make the function an odd function and hence derive its Fourier 
coefficients. 


Determine the coefficients of a series of sines representing the square 
wave in Fig. P3.3 with a proper choice of the time origin. 

Confirm your result, using the cosine series found in problem 3.3(a) 
with an appropriate shift of the time origin 


The graph sketched in Fig. P3.4 represents half of a periodic function. 
Sketch the second half of the function so that 


(a) 
(b) 


The function is even 


The function is odd 


0 1 2 3 4 r(s) 


Figure P3.4. 


(c) Carry out a development of the Fourier series similar to the one car- 


ried out in the case of an even function to show that the bg coeff- 
cients in the Fourier series representation of an odd function can be 
determined by integrating over only the positive half-period and then 
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3.6. 


Fourier Series 


multiplying by 2. You should obtain the following result: 


ar =0 

T/2 

bk = >= f (t) sin(kKQ pt)dt 
0 


Consider the full-wave rectified sinusoid signal (xq(t)) in Fig. P3.5. Here, 
A is the maximum amplitude of xq(f). 


3.7. 


Figure P3.5. 


(a) Derive an expression for the Fourier spectrum (Xgs for k = 
0, +1, +2, +3, ...) of the signal, xg(t) (Hint: Using the param- 
eters provided in the figure, find an expression for the full-wave rec- 
tified sinusoid signal xa (t) and then work on it). 

(b) Determine the average power (p) of the signal, xa (t). 

(c) Plot the power spectral density of xa(t) (i.e., the plot of |X;|2 as 
a function of k = 0,+1,+2,+3,...). Show the plot for k = 
0, +1, +2, and +3. 

(d) Prove the validity of Parseval’s relation (i.e., the average power esti- 
mated directly from xq(t) is equal to the power estimated from the 
Fourier coefficients) for this signal. 


Find the Fourier series for the following functions: 
(a) 8sin(7t), 

(b) cos(2t) + sin(4r), 

(c) sin? (t). 


3.8. A periodic signal x(t) = x(—t) is real, symmetric about £ = 0. It 


3.9. 


has a period T, = A Show that its Fourier series, x(t) = ... + 

Xe Ort 4 pert 4 Ky elie p... degenerates to become a 

cosine series of the form, x(t) = aọ + 2a;cos(Qpt) + 2a2 cos(2Q pt) + 
.., where dg, a1, . . . are real. 

A signal that is sometimes used in communications systems is the raised 

cosine pulse. Figure P3.9 shows a signal x(t) that is a periodic sequence 

of these raised cosine pulses with equal spacing between them. 
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1+ cos(27t ) |z| < 0.5 


¢ ~ 


2 t 


=2 0 


Figure P3.9. 


(a) Show that the first three terms in the Fourier series expansion of x(t) 
are given by, 


1 8 1 
x(t) == em an cos(zt) + = z cos(2nt) +. 


3.10. Show that the Fourier series coefficients for the signal x(t) shown in 
Fig. P3.10 below are given by, 


me 2 1 kr . (kr 
k = = cos z sin z 


rs 


a a) a 0 RER. 


N 


Figure P3.10. 


(a) Hence, show that 
~ for k=...,1,5,9,... 


X,p=4—-4 for k=...,3,7,11,. 
0 for k=. 0.2,4,6,8,. 


(b) Then show that the Fourier series expansion for the signal can be 
written as, 


x(t) = ad 5 £ a cos ((2m + 1)zt). 


er, 


DOT: 10.1561/978168083979 1.ch4 


Chapter 4 


Fourier Transform 


In Chapter 3, we discussed Fourier series as a tool for frequency-domain representa- 
tion of periodic signals. But, most of the signals in practical situations/applications 
are non-periodic (or, aperiodic) in nature. In this chapter, we discuss the representa- 
tion of non-periodic signals in terms of sinusoids. The resulting frequency-domain rep- 
resentation is known as Fourier transform. Clearly, the Fourier transform approach 
has much more practical relevance and use compared to Fourier series. As a special 
case, we also consider periodic signals as well. 
In this chapter, the following important points are discussed in detail. 


e The role of sinusoids as basic building block for synthesizing signals. 

e Representation of aperiodic signals using sinusoids. 

© The continuous-frequency nature of the spectra of aperiodic signals, as compared 
to the discrete-frequency spectra of periodic signals. 

e Various properties of Fourier transform representation, and their use in practice. 

© Concept of impulse function and its use in signal processing. 


Fourier transform of periodic signals. 


Fourier transform as a fundamental tool for spectral estimation. 
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4.1 Introduction to Fourier Transform 


Let x(t) be a periodic signal with period Tp. Then, from our discussion of Fourier 
series in Chapter 3, we may recall the following points (with fp = T and 


Qp, = 21 fp). 


¢ Fourier series representation of x (t) is given by, 


[0,0] 
op ee, (4.1) 
k=—0oo 
1 [T2 
Xk = — / x(t)e Jr dt, (4.2) 
Tp J-T,/2 


fork = 0, +1, +2,.... 


e Complex sinusoids of frequencies 
{--- , -30,, —2Q), —Qp, 0, Qp, 2Qy, 3Qy,--+} 
and corresponding (complex) amplitudes 
{++ ,X_3, X-2, X-1, Xo, X1, X2, X3,°°-} 


are used as component signals to express the signal x(t). 

e The Fourier coefficient Xg gives the strength (i.e., magnitude and phase) of 
the k’" harmonic e/*®»! in the given signal x(t). In other words, Fourier 
series gives a frequency-domain representation of periodic signals. 

e The magnitude spectrum (i.e., |X%| vs k), which is the distribution of the 
amplitudes of the sinusoids as a function of frequency, gives explicit informa- 
tion on the frequencies present in x(t) (Note: k indicates the frequency kQ p). 
The magnitude spectrum can be used to assess the effective bandwidth of the 
signal. Effective bandwidth refers to the maximum frequency present in x(t) 
with non-negligible amplitude. 


But, Fourier series representation is applicable for periodic signals only. Since most 
of the practical signals we deal with are non-periodic in nature, a natural question 


arises: 
How to deal with non-periodic signals? 
The answer to this question is Fourier transform. 


§ Fourier transform is the approach to obtain frequency-domain representation of non- 


periodic signals. 
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4.2 Fourier Transform: Development and Interpretation 


Let x(t) be a non-periodic signal. Note that a non-periodic signal can be consid- 
ered as a periodic signal where the period is infinity. We shall use this principle for 
deriving Fourier transform based on our knowledge of Fourier series. 

Let us construct a periodic signal x p(t) (shown in Fig. 4.1(b)) with period Tp 
by periodically repeating the non-periodic signal x(t) (shown in Fig. 4.1(a)) as’ 


T T, 
Xpt) = x(t for — Æ <t < 
: ) 2 4 (4.3) 
and x,)(t+mT,) = xpt) for any integer m. 
Hence, we can write a Fourier series representation for x p(t) as 
(oe) 
wO= > xe (4.4) 
k=—0o 
1 To/2 , 
X = — f xp tje rdt, (4.5) 
Tp J—T9/2 


fork = 0, +1, +2, .... Now, based on Eqs. (4.3), (4.4) and (4.5), we have the 
following remarks (with f, = T) 


x(t) 


= ti 0 ty t 


—Ty—t; -h -h+ —t 0 hy. ht. Gieta t 


Figure 4.1. Construction of the periodic signal, x(t) of period T, shown in (b), using the 
non-periodic signal, x(t) (a). 


1. Without loss of generality, it is assumed that x(t) = 0 for |t| > 25 
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e As Tp — œ (or, fp — 0), the periodic signal xp(t) will approach the 
non-periodic signal x (t). 

© Let fi < f < fo denote a small frequency range. The number of complex 
sinusoids (i.e., e/*%!) in Xp(t) which lie in this range is given by Beh 


Then, consider the following. 

— As Tp > œ, the number of complex sinusoids that fall within the small 
frequency range tends to infinity. 

— The power of the signal is given by the sum of |X,|7 of all the sinusoids 
that make up the signal. Since the power of a given signal x(t) is fixed,’ it 
is easy to see that the values of |X k|? must tend to zero as? Tp > ©. 

— Therefore, we cannot use X; to denote the frequency-domain representa- 
tion of xp(t) (or, x(t)) as Tp > œ. 


e Let us define 
A Xk 
X(kfp) = TpXk = Tp => Xk= fpX(kfp). (4.6) 

p 


Then, as Tp > 00, we have 


Xp(t) > x(t), fp> df, kf > Í 


(4.7) 
Xk > X(Pdf, XıTp > X(f), 


where df is an arbitrarily small frequency (almost zero) and f is the 
continuous-frequency variable. 
§ Examine the units of Xg and X(f). 


e Using Eq. (4.6), we can rewrite Eqs. (4.4) and (4.5) as 


xpt)= >) [FpX (kfp)] ef?" (4.8) 
k=—0o 
Tp /2 , 
x= | xp(the J? ott, (4.9) 


N 


The power of a non-periodic finite-energy signal is zero. 


3. For example, consider the frequency region from 100Hz to 110Hz, and the following values of fp: 10Hz, 
1Hz, 0.1Hz, 0.01Hz, 0.001Hz, 0.0001Hz, .... Then, as fp keeps decreasing, the number of harmonics 
that fall between 100Hz and 110Hz keeps increasing. 
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With Tp — œ and substituting Eq. (4.7) in Eqs. (4.8) and (4.9), we get, 


x(t) = f O dfe” = f S Aeaf 410) 


CO 

x)= / xaje "dt. (4.11) 
—0O 

Eq. (4.11) is called the forward Fourier transform (the analysis equation). That 

is, getting the frequency-domain X (f ) from the time-domain x (t). Equation 

(4.10) is called the inverse Fourier transform (the synthesis equation). That 

is, getting the time-domain x(t) from the frequency-domain‘ X (f). 


We have the following remarks on the Fourier transform representation given in 


Eqs. (4.10) and (4.11). 


e Complex sinusoids of all frequencies (i.e, -oo < f < 00; continuous- 
variable) are required for representing non-periodic signals. But the Fourier 
transform X (f) will be different for each signal. 

e The amplitudes of the complex sinusoids used in Fourier transform are given 
by X(f)df, compared to Xx in Fourier series (Note: df is arbitrarily close 
to zero). 

e Because X(f) is a complex number, we can express it as 


X(f) =X (Pe (4.14) 
where XDI = X2) +X) (4.15) 
and 6(f) = tan”! (ZL) (4.16) 


Here, X(f) = X, (f) + jXi(f) with X, (f) and X;(f) being the real and 

imaginary parts, respectively, of X (f). 

— Magnitude Spectrum of x(t): It is the plot of |X (f )| vs f Ge., distribution 
of magnitude vs frequency). 


4. The inverse and forward Fourier transform equations can also be expressed in terms of the radian frequency 
variable Q = 27 f as, 
1 f” Q ; 
x(t) = z X(— iad (4.12) 
27.) 6a 2m 


X (=) = ia Heldt. (4.13) 
2m 2o 
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— Phase Spectrum of x(t): It is the plot of O(f) vs f (ie, distribution of 
phase vs frequency). 
The Fourier transform X (f) gives the frequency composition of the given 


signal x(t). That is, 


§ By observing the function X (f ), we can know which all frequencies (or, frequency 
regions) are required to construct the signal x(t). 


§ Fourier transform gives a frequency-domain representation of non-periodic signals. 


Energy (density) Spectrum of x (t): As shown earlier in Chapter 2, we get the 
energy of the signal x(t) as (see Eq. (2.4)), 


I= l ” (dt = | ” XPa. (4.17) 


Eq. (4.17) is known as the Parsevals Theorem for non-periodic signals, which 
says that we can use either time-domain expression or frequency-domain 
expression for computing the energy of a signal, depending upon which is 
easier to use. 

Therefore, the energy density spectrum (i.e., distribution of energy vs 
frequency) of x(t) is given by |X (f)|*. Consequently, the energy of x(t) in a 
frequency range f3 < f < f4 can be obtained by, 


fa 
1 IX (Pdf. (4.18) 


fs 


Example: Consider an example of a rectangular pulse signal (x(t) = rect(z)’, 
shown in Fig. 4.2(a)) defined as follows: 


1 for |t| < 0.5 


O= for k > 0S or) 


Its Fourier transform is calculated as, 


X(f)= f i x(tye "dt 


0.5 -jQ . 
= eI dt — $ É | 
~0.5 -JQ J_o5 
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-1.5 -1 -().5 0 0.5 1 1.5 
Time (Sec.) 
(b) 
= = athe -F T Z4 3g ALi -F T T 


L Ł 1 


-5 —4 —3 —2 —I 0 1 2 3 4 5 


Frequency (Hz) 


Figure 4.2. FT of rectangular pulse: (a) x(t) = rect(r), and (b) Fourier Spectrum (X(f) = 
sinc(f)). 


7 e7I0.52 _ oj0.5Q _ —2j sin(0.5Q) 
E -jQ © -jQ 
sin(0.5Q) sin(æf) 
= = sinc(f). 4.20 
0.5Q af a = 


Figure 4.2(b) shows sinc(f) as a function of frequency (f). It can be seen 
that the maximum of SiNC(f) is 1.0 and it occurs at f = 0. It can also be seen 
that the first zero crossings (on either side of the frequency axis) of SINC(f) is 
at | and —1, respectively, which corresponds to the reciprocal of the width (T) 
of the rectangular pulse. In this case, T = 1. The subsequent zero crossings are at 
frequencies fk =k/T; k = +2, +3,.... The width of the main lobe of sinc(f) 
is Z. As T increases, the main lobe width decreases and vice versa. In the limiting 
case when T — œ, the sinc function becomes an impulse function. 


4.3 Properties of Fourier Transform 


The FT theorems and properties are tabulated and is available in Appendix B. We 
shall now briefly look at some of the important properties of Fourier transform 
(FT). Let x(t) and y(t) be two non-periodic signals with FIs X(f) and Y(f), 
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respectively. That is, 


i= f S aperta y= f “ y(Hel*ar 


D= fo rota, y= [oe Par 


4.31 Linearity 


Let us construct a new signal z(t) as the linear combination of x(t) and y(t). 


That is, 


z(t) = ax(t) + y(t), (4.21) 


where a and J are two scalars (real or complex). Then, we can obtain the FT of 
z(t) as 


Z(f)= f i z(the "Fat 


= f lax (t) + By(t)]e idt 


[0.0] . [0,0] . 
> ax(ye Par + | By Oei? dt 
—oo 


—0o 


[0,0] n [0,0] . 
= af x(the JF de + sf yte "Fat 
(oe) —00 


=aX(f)+PY(f). (4.22) 


Thus, FT of a linear combination of signals is given by the corresponding linear com- 
bination of the FTs of the individual signals. 


4.3.2 Time Shifting 


Let z(t) = x(t — to) where fo is an arbitrary time offset. Then, the FT of z(t) is 
given by 


Z(f)= f z(te "dt = f x(t — toe I?" at 
—00 —00 
oo . 
= x(uje P27 Uto) qy :u =t — to 
—00 
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oo r 
a. x(uje ~?’ "du 
J —CO 
=e} fox (f), (4.23) 


Let 6,(f) and @;(f) be the phase spectra of z(t) and x(t), respectively. Then, we 
can express Eq. (4.23) as 


IZ (ei = eIn NO X (fel PD 


= IX (Plet Ox P22 fo) (4.24) 
= |Z(f)|=|X(f)I, and (4.25) 
OF) = Ox(f) — 2x fto. (4.26) 


Thus, we see that shifting a signal in time-domain results in a phase change in the 
frequency-domain, while the magnitude spectrum remains unaffected. Note also that 
this phase change is a linear function of frequency. 


4.3.3 Frequency Shifting or Modulation 


Let z(t) = e/?*/0'x(t) where fo is a given non-zero frequency. Then, we get its 
FT as 


Z(f) = f > [ero] eift dt 


[0,0] 
_ ip r(e -tdt 


—00 


=X(f — fo), (4.27) 


by the definition of FT. 

The frequency shifting property of the FT is illustrated in Fig. 4.3. It can be seen 
that the spectrum of z(t) is a frequency shifted (to the right in the frequency axis) 
version of |X (f)|. On the other hand, if the frequency shift is by — fo, then the 
spectrum would shift to the left in the frequency axis. The corresponding spectrum 
would be, Z(f) = X(f + fo). As an example, let fo = 1 MHz. Then, Eq. (4.27) 
implies that multiplying x(t) by e/?7/0' results in shifting the spectrum to the right 
by 1 MHz. This principle is used in communication systems for shifting a signal 
from one frequency range to another for transmission purpose. 
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XI 
—B 0 B f 
(a) 
IZAI 
XCF — fo)| 
0 fo—B fo fo+B f 
(b) 


Figure 4.3. Illustration of ‘frequency shifting’ property of the Fourier transform. 


(a) spectra of x(t), and (b) spectra of z(t) = e}? fot x(t). 


4.3.4 Time Reversal 


Let z(t) = x(—1). Then, we get 


Z(f) = f > x(—te 7" dt 


—00 


öö l 
= -f x(ujel?* "du: u = —t 
CO 


CO f CO : 

= rade du = f x(uje 7M dy 
—CO —CO 

=X(-f). 


(4.28) 


That is, reversing a signal in time-domain results in reversing its spectrum in the 


frequency-domain. 


4.3.5 Time Scaling 


Let z(t) = x(t /a) where a is a real number. This is called time-scaling. This results 


in z(t) being an expanded or compressed version of” x(t). 


5. To see this, define t/ = t/a and, for example, consider the interval —10 < t < 10. Ifa = 2, then this 
interval in £ corresponds to the interval —5 < t < 5 in t’. Similarly, if a = 0.5, it corresponds to the 
interval —20 < t/ < 20 int’. Thus, |a| > 1 results in expanding the signal x(t) and |a| < 1 results in 


compressing the signal x(t). 
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The FT of z(t) is derived for the case ofa > 0 and is given by, 


Z(f) =aX (af). (4.29) 


Let us now consider the case whena < 0. Noting thata = —|a| whena < 0, we get 


Z(f) 


oo . 
| x(t Jaje}? "dt 


J —OO 


= l 
af x(uje if udu :u=t/a 
[0.0] 


=" . 
—|a| / x(uje 7}? dy 
J CO 


a f x(uje 127 Pudu 
= |a|X(af). (4.30) 


Comparing Eqs. (4.29) and (4.30), we see that we can take |a| X (af) as the FT of 
the time-scaled signal x (t/a) for any a (i.e.,a > Oora < 0). 

Note that X (af) results in scaling in the frequency-domain. In particular, we 
note the following: 


© Case 1: |a| > 1- Results in expanding x (t) in time-domain and compressing 
X(f) in frequency-domain. 

e Case 2: |a| < 1- Results in compressing x (t) in time-domain and expanding 
X(f) in frequency-domain. 


Example: Consider an example of a rectangular pulse (x(t) = rect(t)’) 
(Fig. 4.4(a)) and its time scaled pulse z(t) = x (5) as shown in Fig. 4.4(b) below. 
The first rect signal has a width of T = 1 second and the second one has a width 
of T = 1.5 seconds. The corresponding spectra are shown in Figs. 4.4(c) and 
4.4(d), respectively. As explained earlier, z(t) is a time-expanded version of x(t) 
and correspondingly, its FT, Z(f) is a frequency compressed version of X(f). 
This is clear from the two sinc functions in the figure. The maximum ampli- 
tude of the sinc function in Fig. 4.4(c) is 1.0 and the zero crossings of it occurs 
in frequencies fy = k/1.0; k = +1,+2,.... For the second sinc func- 
tion in Fig. 4.4(d), which corresponds to the FT of time-expanded rect function 
(z(t)), the frequency compression is very clear. Its zero crossings are at frequencies, 
fk = k/1.5; k = +1,+2,.... The maximum amplitude of the sinc function 
is 1.5 (see Eq. (4.30)), which is the time-scaling factor. 
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Figure 4.4. FT of rectangular pulses: (a) rect(t) (b) rect(74), (c) Fourier spectrum of 
rect(t), and (d) Fourier spectrum of rect(;4). 


4.3.6 Time Scaling and Delay 


Let z(t) = x (=!) where to and a are real numbers. Clearly, z(t) is a time-scaled 


and time-shifted version of x(t). The FT of z(t) (assuming a > 0 for convenience) 
is given by 


oe t-t ; 
Z(f) a ï (=) eift 
-oo a 
oO . 
= af x(uje i? Ff eut) gy : u = (t — to)/a 
—oo 
(oe) 
= geri x (uje? Pdu 
—00 
= ae lS X (af). (4.31) 
As before, if a < 0, then we would get, 


Z(f) = jaje} "X (af). (4.32) 
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Figure 4.5. Amplitude scaled and shifted rectangular function. 


Example: Let us apply the time scaling and delaying to the problem of a rectangular 
pulse as given in the following expression: 


7 for 2<t<4 


y= {0 for t<2,1>4. ee 


Figure 4.5 illustrates the given function z(t). Clearly, this signal is a time-scaled 
and time-shifted version of the standard rect(t) function which is defined as 


1 for -O5<71<05 
fe a i for t < —0.5, t > 0.5. (%32) 
So, we can express z(t) as 
t—t 
z(t) = 7rect ( °). (4.35) 
a 
Comparing the waveforms of z(t) and rect(t), we see that the points t = —0.5 


and t = 0.5 in rect(t) correspond to t = 2 and t = 4, respectively, in z(t). 
That is, 


(t — to)/a = —0.5 when t=2 (4.36) 
(t — to)/a = +0.5 when t = 4. (4.37) 


So, we can determine to and a by solving the equations: 
2 = —0.5a + to and 4 = 0.5a + to 


which results in tọ = 3 and a = 2. Therefore, we get 


z(t) = 7rect (+). (4.38) 
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Since the FT of rect(t) is sinc(f), we can get the FT of z(t) using Eq. (4.31) as 


Z(f) =7 [2e-7*/3sinc@ P| = 14e7/*f sinc(2 f). (4.39) 


4.3.7 Time Differentiation 


Let z(t) = xD, To determine the FT of z(t), recall from Eq. (4.10) the inverse 
FT expression: 


x(t) = | i X(fyel**df. (4.40) 


Differentiating both sides of this equation, we get 


dx(t) B 
dt 


[xe cxn|ar 


= D 2af X(f) e} df. (4.41) 


Eq. (4.41) is in the form of a standard inverse FT where the time-domain signal is 
dxo) with its corresponding FT j2af X (f). Therefore, we get the FT of z(t) as, 


Z(f) = j2afX(f). (4.42) 


From Eq. (4.42), we note that differentiation in time-domain results in attenuating 
low-frequency part of the spectrum and amplifying high-frequency part of the spectrum 
in frequency-domain. In particular,’ note that Z(0) = 0 whether or not X (0) = 0 
at f = 0. 


4.3.8 Duality 


If X(f) is the FT of x(t), then the FT of X (t) is given by’ x(— f). Similarly, the 
FT of X (—t) is given by x(f). Using this, we can easily see that the FT of sinc(t) 
is rect(f), since we know that the FT of rect(t) is sinc(f). 

Example: Consider an example of a rectangular pulse signal (X(f) = rect(f)’, 


in the frequency domain as shown in Fig. 4.6(a)) defined as follows: 


1 for |f| < 0.5 


0 for |f| = 0:5, i 


x=] 


6. Note that X (0) is the total area under x(t) (i.e., a x(t)dt). 


7. Prove this by applying simple change of variables in Eq. (4.11). 
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Figure 4.6. FT of rectangular pulse in the frequency domain: (a) rect(f), (b) Fourier spec- 
trum (sinc(rt)). 


By taking the inverse Fourier transform, we get 


x(t) = f i X(fye?"™" af 


0.5 | ejot 705 
feu- 


ej270.5t — ef2x0.5t 2j sin(x t) 


j2ut j2at 


o ince (4.44) 
mt 


The resulting sinc function is plotted in Fig. 4.6(b). This explains the duality 
property of the FT. 
4.3.9 Symmetric Signals 


As in the case of Fourier series, the FT X(f) also has some special features when 
x(t) is real and/or symmetric. We list them below: 


e Real x(t): That is, x*(t) = x(t). Then, we will have X(—f) = X*(f). 


This results in even-symmetric magnitude spectrum and odd-symmetric phase 
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Spectrum: 


XCD SIXI,  8CF) = -0(f). (4.45) 


e Real and Even-Symmetric x(t): That is, x* (t) = x(t) and x(—t) = x(t). 
Then, we will have, 


XCF) = X"(f) = Xf). (4.46) 


That is, X(f) is real and even-symmetric. The phase 0(f) is either 0 or £7. 
© Real and Odd-Symmetric x(t): That is, x* (t) = x(t) and x(—t) = —x (t). 


Then, we will have, 


X(—f) = -X(f) = X"(f). (4.47) 


That is, X(f) is imaginary and odd-symmetric. The phase 0(f) is +7 /2. 
© Real X(f): That is, X*(f) = X(f). Then, we will have, 


x(—t) = x* (t). (4.48) 
That is, x(t) is conjugate-symmetric. 


© Real and Even-Symmetric X (f): That is, X*(f) = X(f) and X(—f) = 
X(f). Then, we will have, 


x(—t) = x*(t) = x(t). (4.49) 
That is, x(t) is real and even-symmetric. 


A summary of the symmetry properties for the FT is shown in Fig. 4.7. 


4.4 Fourier Transform of Periodic Signals 


Recall that the main motivation for the development of FT is that Fourier series 
cannot be used to obtain frequency-domain representation of non-periodic sig- 
nals. While FT is applicable for non-periodic signals, we could ask the following 
question: 


Is Fourier transform also applicable for periodic signals? 


The answer is ‘yes’ and we look into some details of this in this section. 
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Figure 4.7. Summary of symmetry properties of FT. 


4.41 Difficulty with Sinusoids 
Consider a complex sinusoid given by, 
x(t) = Aet CTP) — Aeir fot, (4.50) 


where A, fo and @ are the real-amplitude, frequency and phase, respectively, and 
A = Ae/®. Then, it is easy to see that the Fourier series coefficients of x(t) are 
given by, 


x= {9 for k =1 (4.51) 


0 for kK#1. 


That is, the frequency-domain representation of a complex sinusoid has only one 
non-zero value and this corresponds to the frequency of the sinusoid. 

We may also apply the standard FT approach for determining the FT of the 
complex sinusoid given above. Let X(f) denote its FT. Based on our knowledge 
of the signal Ae/2™ fol and its Fourier series, we know that X (f) can be non-zero 
only at the frequency f = fo. Further, we also know that its FT X (f) should obey 
the following (see Eq. (4.17)) 


2 | ” |x@Pat = l XAPA, (4.52) 


because of the Parseval’s theorem. On the other hand, for the complex sinusoid 
Aei?T Pot, the energy is clearly infinity. This implies that its FT X(f) at f = fo 
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Figure 4.8. Impulse function. 


should be also infinity! (since X(f) in this case is non-zero only at f = fo). 
In other words, we should have 


Hm, IX (fo) df = œ (4.53) 


where df is an arbitrarily small frequency interval around f = fo. To handle this 
very special and difficult situation, we need to understand the concept behind the 
so-called impulse function. 


4.4.2 Impulse Function 


The impulse function (denoted by ô(t)) and illustrated in Fig. 4.8 is defined as, 


1.0 for t=0 
ns { elsewhere (4.54) 
We also note that 
00O 
f ôlt)dt = 1. (4.55) 
—oo 


So, ô(t) is a function having infinite amplitude and zero width such that its area is 
equal to 1. An impulse sitting at £ = tọ is given by d(t — to). We may also define 
the impulse function using a limiting form asë 


. 1 
jim, [oe E for 0<t < al. (4.57) 


8. The definitions given in Eqs. (4.54), (4.55), and (4.57) can be generalized to the case of the impulse ô(t — to) 
sitting at f = to as 

ôlt — to) =0 for t Æ to (4.56a) 

JS. Ot — to)dt = 1 (4.56b) 

jim, {ôt — t) = + for to <t <to+ A}. (4.56c) 
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4.4.3 Properties of Impulse Function 


Based on the above introduction to impulse function, we can list the following 


properties. 


2. 


e Unit Area: As defined by Eq. (4.55), the area under an impulse function is 


equal to 1 (for any to): 


L. O(t — todt = 1. (4.58) 


—00 


Sampling Property: By multiplying a signal with an impulse function, we can 


obtain the value of the signal at the location of the impulse. That is, 


x(t)d(t — to) = x(to)ô(t — to) = x (to). (4.59) 


Consequently, a discrete-time signal x(nT;) can be obtained from a 
continuous-time signal x(t) by multiplying x(t) with a train (or, sequence) 
of impulses spaced Ts apart. That is, 


[0.0] CO 
yYQ=xQ) x DP) öt -nT)= $, xnT,)d( — nT) 
n=—CO n=— 00 
=---+x(-27,)d(t + 2T,) + x(—T,)6(t + Ts) + x(0)ô(t) 
+x(T;)6(t — Ts) + x(2T;)d(t — 2T;) +- (4.60) 
That is, 
_ | x(kTs)0(t —kTs) if t =kTs 
y(t) = Į iE t ART. (4.61) 
fork = ..., —2, —1, 0, 1, 2, . . . and Ts is the sampling interval.” Thus, y(t) 


is a discrete-time signal, that is, non-zero only at the discrete-time instants 
kT;, k = 0, +1, 42,.... 


There is yet another property known as shifting property of impulse function. We will study this later. 
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e Flat Fourier Transform: The FT of ô(t — to) is given by” 


Felt — to)] = f O(t — toje?" dt 


—00 


Co 
= f O(t — to)e i? dt : Eq. (4.59) 


—00 
[0.0] 
setam] O(t — to)dt 
Jy —00 
= ei nft, (4.62) 


because of Eq. (4.58). Thus, the magnitude of the FT of ô(t — to) is flat 
over the complete frequency range (—o© < f < œ) and its phase is given by 
—2n f to. 


4.4.4 Fourier Transform of Sinusoids 


Since the FT of a time-domain impulse d(t — to) is e~/ 2r fto, let us examine what 
is the inverse FT of an impulse 6(f — fo) in frequency-domain, where fo is a 
frequency offset. Using Eq. (4.10), we obtain" 


Py == | if — foje tdf 


= 1 7 Of — foe?" af : Eq. (4.59) 


CO 
= ezt | AF- fojdf 
—00 

Sa (4.63) 
which is nothing but a complex sinusoid of frequency fo. Thus, 


§ The FT ofa complex sinusoid of frequency fo is an impulse 0( f — fo) located at frequency 
fo. 


Generalizing this to the complex sinusoid x(t) = Ae/?7/0' given in Eq. (4.50), we 
get its FT as 


F | Aet] = Ad(? — fo). (4.64) 


10. The notation ‘F [x(t)] refers to the ‘Fourier transform of x(t)’. 


11. The notation ‘F~! [X(f)]’ refers to the ‘inverse FT of X(f)’. 
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Since the FT given in Eq. (4.64) is an impulse function (which has infinite 
amplitude), we see that this satisfies Eq. (4.53). 


4.4.5 Fourier Transform of Periodic Signals 


We shall now use the result in Eq. (4.64) to determine the FT of any periodic signal. 
Let x(t) be a periodic signal with period Tp = Fy where fp is the frequency of 


the periodic signal, and Fourier series representation given by 


(0,0) 
= ee, (4.65) 


k=—0o 


Since e/?* ‘fp! is a complex sinusoid of frequency k fp, using the linearity property 
of FT, we can get the FT of x(t) as 


X(f) =F [x()] = z| 5 d 


k=—0o 
o0 

= > F [ea] 
k=—00 
oO 


Z 5 XLF fa] 


k=—0o 


= >) Xô — kfp). (4.66) 


k=—0o0 


That is, 


Xrôlf —kfp) if f=kfp 


0 if f #kfp. ee) 


x(n =| 


fork = ...,—2,—1,0,1,2,...and fp is the fundamental frequency. Thus, we 
see that 


$ The FT of a periodic signal exists only at frequencies corresponding to its harmonics kf p. 


For this reason, such spectra are also known as line spectra. 


In other words, knowledge of the Fourier series coefficients is sufficient to determine the 
FT of periodic signals. 
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4.5 Dirichlet Conditions 


A signal x (t) that satisfies the following conditions is guaranteed to have a Fourier 
transform: 


e It must be absolutely integrable. That is, 


+00 
L |x(t)|dt < co. (4.68) 


e It must have only finite number of maxima and minima within any finite 
interval. 

e It must have only finite number of discontinuities, all of finite size, within 
any finite interval. 


These conditions are known as Dirichlet conditions for existence of FT. 


4.6 Fourier Transform Summary 


In Table 4.1, we summarize the key properties of Fourier transform for continuous- 
time signals. 

In Table 4.2, we give the Fourier transforms of some of the most commonly used 
signals. 

Recall that u(t) is the unit step function which is defined as 


1 for t>0 
a l for t<0 ae 
Therefore, the meaning of the expression e~“‘u (t) is as follows: 
a Je” for t>0 
JL g F for t <0. oe 


Thus, the one-line expression e~“u(t) is an easier way to express the 2-line equa- 
tion given by Eq. (4.70). 
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Table 4.1. Properties of Fourier transform. 
Property Time domain Frequency domain 
Linearity ax(t) + y(t) aX(f) + BY(f) 
Time shifting x(t — to) eirf (fF) 
Time Scaling x (t/a) la|X (af) 
Time shifting x (=) jale}? "X (af) 
and Time Scaling 
Time reversal x(—t) X(-f) 
Frequency shifting e/?t fol x(t) X(f — fo) 
Modulation x(t) cos(2z fot) X(f = fo) t X(f + fo) 
Modulation x(t) sin(2z fot) Xf = n X(f + fo) 
Differentiation a j2afX(f) 
Real Signal x*(t) = x(t) X(—f) = X*(f) 
Real and x*(t) = x(t) = x(-1) X(-f) = X*(f) = X(f) 
Even-Symmetric 
Real and x*(t)=x(t)=—x(-t) X(-f)=X*(f)=-X(f) 


Odd-Symmetric 


Table 4.2. Fourier transform of selected signals. 


Time domain Frequency domain 


x(t) X(f) = > x(the 2" dt 
rect(f) sinc(f) = ma) 
af 
o(t) 1 
ôlt — to) e i?r fto 
efx fot o(f — fo) 
e u(t) : if a>0O 


a+ j2af 
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4.7 Concluding Remarks 


e Fourier transform can be used to give frequency-domain representation of 
non-periodic as well as periodic signals. In contrast to this, Fourier series can 
be used only for periodic signals. 

e Fourier transform of non-periodic signals are continuous in the frequency- 
domain, whereas that of periodic signals is discrete (line spectra). 

e Fourier transform can be used to assess the effective bandwidth of signals. 

e The various properties of Fourier transform can be used to simplify the effort 
(integration, computations etc.) necessary in evaluating the Fourier transform 
or to verify the solutions. 


Exercises 


4.1. Consider the continuous signals shown in Fig. P4.1. 


A 
€ A/2 
= A/ 
0 
—6T —4T —2T 0 2T AT 6T 
A 
& 
-Å 
—6T —AT —2T 0 2T AT 6T 
A 
= A/2 
0 
—3T -2T -T 0 op 2T 3T 
A 
am = 
8 
0 
—3T —2T -T 0 1 2T 3T 
Time (seconds) 


Figure P4.1. 


(a) Find the spectrum of the signals in Fig. P4.1 using exclusively (only) 
the spectra of basic signals in combination with the appropriate prop- 
erties of the Fourier transform. 

(b) Sketch roughly the amplitude spectra of x (t), x2(t), x3 (t) and x4(f). 
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4.2. The analog signal in Fig. P4.2(a) represents the impulse response of a 
biological system. The amplitude of the corresponding transfer function 
(H (f), the Fourier transform of the impulse response h(t)) is determined 
in two ways, and the results are depicted in Fig. P4.2(b) and Fig. P4.2(c), 


respectively. 
1 Wai be (a) — a J | 
= 0 
=1 
0 1 2 3 4 5 6 
Time (Sec.) 
0.4 (b) : 0.4 p (c) 
0.3 0.3 
= 0.2 — 0.2 
= = 
0.1 0.1} 
0 0 
0 1 2 0 l 2 
Frequency (Hz.) Frequency (Hz.) 
Figure P4.2. 


Express |H(f)| for f = 0 of h(t). Using the result argue which of the 
results is incorrect. 
4.3. An ultrasound system for investigation of the blood flow in the body uses 
a pulse given by: 


p(t) = v(t) sin(2z fot). 


Here, fo is the frequency of the pulse and v (t) is the Hamming window 
given by, 


Ge 0.54 + 0.46 cos (x L) for tl <T 
04) = 0 otherwise 
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The spectrum of v(t) is 


1.08 — 0.6472 f? 


anf (i = 47? f?) sinQQafT). 


v= 


The window (v(t)) and its amplitude spectra (V(f)) are shown in 
Fig. P4.3. 
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— h — a 
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Frequency (Hz) 
Figure P4.3. 


Write down how one can find the spectrum P(f) of p(t) out from 
V (f) by using appropriate properties of the Fourier transform. Show that 
P(f) is concentrated around f = + fo, when T > F 


4.4. To estimate the blood velocity, two identical pulses (p(t)) are transmit- 


ted one after the other separated by T,,¢ seconds. Two signals yj (t) and 
y2(t) are received, respectively. For the sake of simplicity, it is assumed 
that the zero time instance (t = 0) for the two signals y(t) and y2(t) 
coincides with the time instance when the respective pulses have been 
transmitted. The signal reflected by the blood can be approximated with 
a single reflector with reflection coefficient a, such that the received signal 
from the first pulse transmission can be written as: 


yı) = ap(t — to) + go(t), 


where a and fo are real positive constants. g,(t) is the signal received 
from the tissue surrounding the blood. At the next pulse transmission, 
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the received signal is: 


y2) = ap(t — to - ts) + g(t), 


where 


Vp is the speed of the blood, c is the speed of propagation of ultrasound 
signal. Figure P4.4 shows the two received signals. 


yi(t) 


to 


to + ts 


Figure P4.4. 


(a) The signal from the tissue, g, (t) is much stronger than the signal 
from the blood. To remove its influence, the two received signals are 
subtracted from each other. The resulting signal is denoted as d (t). 
Show that g,(t) is not present in the signal d(t). Write down the 
spectrum D(f) expressed through P (f), a, to and fs. 

(b) In the last question, we assume that Vp = 0.75m/s and c = 1500 
m/s. For real applications, Tp,f = 200us, fo = SMhz, and T = 
2us. Explain why d(t) has no spectral components for |f| = fo, 
for the chosen parameters. Derive and give your reasons, that if one 
chooses other values for T and Tprf, then this situation can be 
avoided. 
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4.5. 


4.6. 


4.7. 


4.8. 


Fourier Series 


Determine the signals that have the following Fourier transform (FT): 


(a) 


Aei er a sa ee 
(b) 
X (Q) = cos? (Q). 
(c) 


1 for Q,- 9 <Q] <9, +% 
0 otherwise. 


x(a) = | 


(d) For the spectrum given in Fig. P4.5 below: 


x(a) 
2 
=i 3z z 0 namam A 
8 8 8 8 g 8 
Figure P4.5. 


A single pulse emitted by a medical device for imaging purpose is shown 
in Fig. P4.6. Suggest a mathematical expression for the pulse. Write down 
a formula from which its energy can be calculated. Suggest a reasonable 
upper bound for this energy. What is the pulse’s power? 

The pulse in Question 4.6 is found to have a one-sided magnitude spec- 
trum as shown in Fig. P4.7. Suggest a value for fo. Will the phase spec- 
trum of the signal be 0? If the device is emitting a series of these pulses at 
the rate of one pulse per 107 seconds, sketch the magnitude spectrum. 
Consider the block diagram representation of a linear time-invariant 
(LTT) system as shown in Fig. P4.8. Here x(t) and y(t) are the input 
and output, respectively of the system. A(t) in the picture is the impulse 
response of the system. The system function H (f) (Fourier transform of 
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4.9. 


Figure P4.6. 
a 
A 
= 
E 
O 
© 
a 
N 
J J (Hz) 
Figure P4.7. 


h(t)) is given by, 


ACH =e (=r) rect (£) 


Here, ¢ is the time variable, f is the frequency variable and fe is a given 


specific frequency in Hz. 


t 
x(f) ro | y(t) 


Figure P4.8. 


(a) Determine the impulse response h(t) of the system (Hint: h(t) o 
H(f) and F`! [rect(f)] = sinc(t)). 
Two periods of a periodic signal, x(t), are shown in Fig. P4.9. 


(a) Write an expression for x(t) and determine its Fourier transform, 


X(f). 
(b) Another signal, y(t), is constructed as y(t) = x (t)+x(t—1). Is y(t) 
periodic? Justify your answer. 
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Figure P4.9. 


(c) Using your solution to Question (a), determine the Fourier transform 
of the signal, y(t), given in Question (b). 
(d) Let z(t) = x(t) + x(—t). Without doing any derivations, give the 
Fourier transform, Z(f), of z(t). Justify your answer. 
4.10. Consider the pulse signal, x(t), shown in Fig. P4.10. 


Z N 
=1.0 0 1.0 t 


Figure P4.10. Caption 


(a) Write down the expression for x(t). 


Based on the signal x(t) shown in Fig. P4.10, a new signal y(t) is 
defined as 


y(t)=x(t) for —1<t<0 
=0 otherwise 


(b) Determine the Fourier transform, Y(f), of y(t) and using Y(f), 
develop an approach to obtain the Fourier transform, X (f) of x(t) 
(Hint: Express x(t) in terms of y(ft)). 

(c) Fourier transform of rect(t) is sinc(f). Use this information to 
obtain the Fourier transform, X (f), of x(t) shown in Fig. P4.10. 
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12. 


4.11. Part of a signal with biological origin consists of two full periods of a 


sinusoidal signal. This partial signal is denoted as g(t) and can be seen in 


Fig. P4.11, where fo = 3kHz, and d is a positive constant. 


1 i | 


0 0.2 0.4 0.6 0.8 1 
Time (seconds) x10 
Figure P4.11. 


(a) Show that the spectrum G(f) of the signal can be written as 


(b 


wm 


in £ 
G(f) = £ . : (255) 


where kı depends on f. Then, find kı. (Do not calculate Fourier 
integrals.) 

The biological system sends the signal gp(t) consisting of g(t) 
repeated with a period T, in other words: 


00 


gp(t) = > g(t— mT). 


m=—OO 


Sketch the numerical values of the spectrum G p(k)” of gp(t), for 
frequencies below 8kHz. Give the frequencies of the spectral compo- 
nents, when T = Ims. Explain qualitatively, how the magnitude of 
the spectrum (|G p(k)|) changes when T assumes different values in 
the interval from lms to 2/3ms. 

The biological system can maintain the RMS {gp(t)}? approxi- 
mately constant in the said-interval of T, by changing d. 


G p(k) = cx, where cx are the coefficients of the Fourier series. 


13. RMS means the ‘root-mean-square’ value and can be calculated as ,/ 4 Sr 82 (t)dt. 
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Find RMS{g,(t)} for T = Ims. Derive how d must change as a 
function of T and fo, so that RMS{gp(t)} is kept constant for ms 
<T < Ims. 


4.12. A signal x(t) is defined as 


x(t) =e}! for 0<t<1 


=0 otherwise 


(a) Determine the Fourier transform, X (f), of x(t). 

(b) Let y(t) = w(t)e/2*". Determine w(t) such that y(t) is same as 
x(t) given in Problem 1. Determine the Fourier transform, W (f), 
of w(t). Express the Fourier transform, Y(f), of y(t) in terms of 
W (f). Show that the resulting Y (f) is same as X (f) obtained from 
Question (a). 

(c) Draw the magnitude and phase spectra of x (t). 


4.13. Find the Fourier transform of the half-cosine pulse defined as, 


_ t t mt 
x(t) =rec (=) a cos (=). 


4.14. A single raised cosine pulse is defined as, 
rect(t) [1 + cos(2z1)]. 


Find its Fourier spectrum. 
4.15. The spectrum of the Gaussian pulse x(t) shown in Fig. P4.12 is X(f). 


Figure P4.12. 


(a) Express AD in terms of X (f). 


(b) Find the shape of X (f) if AD = =a FRU: 


DOT: 10.1561/9781680839791.ch5 


Complex Signals 


A number of signal processing applications make use of the complex signals. Some 
examples include the characterization of the Fourier transform, blood velocity esti- 
mations, and modulation of signals in telecommunications. Furthermore, a num- 
ber of signal processing concepts are easier to derive, explain and understand using 
complex notation. It is much easier, for example to add the phases of two complex 
exponentials such as x(t) = e/?!e/#2, than to manipulate trigonometric formula, 
such as cos($1) cos(#2) in the rectangular representation. 
In this chapter, the following points are discussed in detail: 


Complex signals in general. 
Fourier spectrum of complex signals. 


Linear processing of complex signals. 


Hilbert transform and their properties. 


Analytic signals and their use. 


5.1 Introduction to Complex Signals 


A complex analog signal x(t) is formed by the signal pair {xp(t), x7 (t)}, where 
both xpg(t) (real part) and x;(t) (imaginary part) are real signals. The relationship 
between these signals for a complex signal is given by, 


x(t) =xr(t) + jx), (5.1) 
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Re 


u—,— 
Xp= a cos() 


Figure 5.1. Illustration of the relationship between the real (xr) and imaginary (xz) parts 
of the complex number x and its magnitude (a) and phase (@). 


where j = /—1. A complex discrete [or digital] signal x[n] is defined in a similar 


manner, 
x[n] = xr[n] + jx7[n]. (5.2) 


A complex number x can be represented by its real (xg) and imaginary (xz) parts 
or by its magnitude (a = |x|) and phase (0 = x), respectively. The relationship 
between these parameters is illustrated in Fig. 5.1. The real part, xg, is the projec- 
tion of x onto the real axis and the imaginary part, xz, is the projection of x onto 
the imaginary axis. 

Complex signals (as a function of time) are defined in both continuous time (t) 
and discrete time (n) as shown below: 


x(t) =a(t)e? and x[n] = afn], (5.3) 


Here, the various quantities are provided in the table below: 


Table 5.1. Various quantities associated with complex signals. 


Continuous time Discrete time 
a(t) = xR) +x70) aln] = xpi] + x7] 
O(t) = arctan % G) O[n] = arctan #4 


XR(t) Xr[n] 
XR(t) =a(t)cos((t))  xr[n] = a[n] cos(@[n]) 
x(t) =a(t)sin@())  xr[n] = a[n] sin([n]) 


The magnitudes a(t) and a[n] are also known as the envelopes of x(t) and x[n], 
respectively. 
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511 Some Useful Rules and Identities 


Many applications require the conversion of the complex number between the rect- 
angular (trigonometric) form and phasor (polar) form. The conversion is done by 
Euler’s formula: 


ei? = cos(6) + j sin(0) (5.4) 
10  „—j0 
cos(0) = = (5.5) 
JO pmi? 
mor =e (5.6) 
2j 


Table 5.2 below shows some useful identities. 


Table 5.2. Some useful identities. 


a 0 ael? 

1 0 e? =] 

1 +r etit = —1 

1 nr etina — —]; n odd integer 

1 +2” e” =] 

1 +Æ2nm e*/™™ = 1; n integer 

1 +4 =j 

1 +7 ei? = +j; n= 1,5,9, 13,... 
1 +7 ei? Sai; n=3,7,11,15,... 


5.1.2 Phasors 


The word phasor is often used by mathematicians to denote any complex number. 
In engineering, it is frequently used to denote a complex exponential function of 
constant modulus and linear phase, that is a function of pure harmonic behavior. 
Here is an example of such a phasor: 


x(t) = Aeh, (5.7) 
which has a constant modulus A and a linearly varying phase. It is not uncommon 


that the modulus and phase are plotted separately. Different ways to depict the 
phasors are illustrated in Fig. 5.2. 
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Real and Imaginary Components 


Figure 5.2. Different views of the phasor Aei? fot, 
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A phasor, whose real part is an even function and imaginary part is an odd func- 
tion is said to be Hermitian. A phasor whose real and imaginary parts are odd, is 
said to be an anti-Hermitian. 


5.2 Spectrum of Complex Signals 


The spectrum of a complex signal can be found by the Fourier method. In the 
following, we will derive the spectrum X (f) of the complex signal x (t) = xr (t) + 
jx1(t) as a linear combination of the spectra Xg(f) and X7(f) of the real valued 
signals xg (t) and xz (t), respectively. 

One consequence of the fact that x(t) or x[n] is complex, is that the typical 
odd/even symmetry of the spectrum are lost. It is easy to demonstrate that the 
following expression is valid for complex signals: 


x* (t) <> X*(—f) and x*[n] 4 X*(-f) (5.8) 


where x*(t) is the complex conjugate of x(t), and (<>) represents a Fourier 
transform pair. 
Let the complex signal x(t) be expressed as, 


x(t) = xR) + jx A). (5.9) 


Let the spectra of the real and imaginary parts be Xr(f) and X7(f), respec- 
tively. i.e., xr (t)  XR(f) and x(t) > X(f). The real part of x(t) can be 
expressed as': 


1 
xr(t) = J (x(t) + x*(t)) ; (5.10) 
Using the linearity property of the Fourier transform, we get 
1 
XR(f) = 5 ZNE) (5.11) 
In a similar way, we get 
1 
xH = —i5 EO- 2°) (5.12) 
and 
1 
L= CEN. (5.13) 


Similar expressions can be derived for discrete complex signals as well. 


1. Remember that (a + jb)* = (a — jb). 
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Table 5.3. Properties of the FT for analog complex signals. 


Let x(t) 9 X(f); xt) © Xi(f); and x2(t) © X(f) 


Property Time and Frequency Domain 

Linearity axı (t) + bxo(t) e aX (f) + bX2(f) 
Symmetry X(t) x(—f) 

Scaling x(kt) e hX (£) 

Time reversal x(-t) e X(-f) 

Time shifting x(t + to) © X(fyei27f 

Frequency shift x(tje s > X(f + fo) 

Time differentiation ZO © (j2at)P X(f) 

Frequency differentiation (— j27t)?x(t) e one ) p is a real number. 
Convolution x10) @ x2(t) Xi (f)X2(f) 1x2) © X(f) 8 X(f) 
Parseval’s theorem Jo xa O dt = SS XAXI (Pdf 


Table 5.4. Properties of the FT for digital complex signals. 
Let x[n] © X(f); xiin] © X1(f); x[n] e X2(f) 


Property Time and Frequency Domain 

Linearity axıln] + bx2[n] e aXı(f)+bX2(f) 

Time reversal x[-n] e X(-f) 

Time shifting x[n + no] 4 X (f)ei?7 "oT; T, is the sampling period. 
Frequency shift x[n]e Ts 4> X(f + fo) 

Differentiation (j2anT,)?x[n] oO oe ) 

Convolution xiin] 8 x[n] © X1(f)X2(f) xinin] e X(f) 8 X2(f) 


Parseval’s theorem X Xy xi[n]xž in] = = e? oo 


5.21 Properties of the Fourier Transform of Complex Signals 


The basic set of properties of the Fourier transform for real signals is also valid for 
complex signals. Table 5.3 gives a short overview of the properties of the Fourier 
transform for analog complex signals. Table 5.4 gives the corresponding properties 
for the digital complex signals. 
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5.3 Linear Processing of Complex Signals 


A complex signal consists of two real signals — one for the real part and the other 
for the imaginary part. The linear processing of a complex signal, such as filtration 
with a linear time-invariant (LTT) filter, corresponds to applying the processing to 
both the real and imaginary parts of the signal. 

The filtering of the complex signal xg (t) + jx7(t) with a filter whose impulse 
response h (t) is real, is equivalent to two filtering operations — one for the real part 
and the other for the imaginary part as follows: 


A(t) Q Erl) + jxr(t)) = ht) 8 xr) + j hE) @ x70). (5.14) 


Here, ® denotes the convolution operation. If the filter has a complex impulse 
response (i.e., h(t) = hr(t)+ jh7(t)), then the operation corresponds to four real 
filtering operations as shown in Fig. 5.3. 

Example of an often-used digital filter with complex impulse response is the one 
given by, 


2a 


1. 
hm{n] = sor O<n<N-l1, (5.15) 


where Ts is the sampling time and m is an integer. N in Eqn. (5.15) is the length 
of the filter. The filter coefficients are clearly complex. The transfer function of the 
filter is derived as, 


_ 1 fsina(fNT; —m) \ -jaN-DOT,-m/N) 
aCe (orn oe j (5.16) 


From this equation, it is clear that the filter transfer function is a function of the 
parameter m. 


Figure 5.3. Filtering of complex signals. 
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Figure 5.4. Impulse response and transfer function of the complex filter for parameter set 
{N,m} = {16, 2}; (a) Real part of the impulse response, (b) Imaginary part of the impulse 
response, (c) Magnitude response of the filter, and (d) Phase response of the filter. 


Figure 5.4 illustrates both the impulse response and the transfer function of the 
filter for parameter set {N, m} = {16, 2}. The real (hoR[n]) and imaginary (h2;[n]) 
components of the impulse response of the filter is shown in Figs. 5.4(a) and (b), 
respectively. Its magnitude response is shown in Fig. 5.4(c) and the phase response 


in Fig. 5.4(d). 


5.4 Hilbert Transform 


Signal processing is a fast growing area today and a desired effectiveness in uti- 
lization of bandwidth and energy makes the progress even faster. Special signal 
processors have been developed to make it possible to implement the theoretical 
knowledge in an efficient way. Signal processors are nowadays frequently used in 
equipment for radio, transportation, medicine, production, etc. 


In 1743 a famous Swiss mathematician named Leonard Euler (1707—1783) 
derived the formula, 


e/* = cos(x) + j sin(x). (5.17) 
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Nearly 150 years later, the physicist Arthur E. Kennelly and the scientist Charles P. 
Steinmetz used this formula to introduce the complex notation of harmonic wave- 
forms in electrical engineering, that is 


ei% = cos(Qt) + j sin(Qt). (5.18) 


Later on, in the beginning of the 20" century, the German scientist David Hilbert 
(1862-1943) finally showed that the function sin(Qr) in Eq. (5.18) is the Hilbert 
transform of cos(Qr) in the same equation. This gave us the +5 phase-shift oper- 
ator, which is a basic property of the Hilbert transform. 

A real function, x(t), and its Hilbert transform, xy (t), are related to each other 
in such a way that they together create the so called strong analytic signal. The strong 
analytic signal can be written with an amplitude and a phase where the derivative of 
the phase can be identified as the instantaneous frequency. The Fourier transform 
of the strong analytic signal gives us a one-sided spectrum in the frequency domain. 
It is not hard to see that a function and its Hilbert transform also are orthogonal. 
This orthogonality is not always realized in applications because of truncation in 
numerical calculations. However, a function and its Hilbert transform has the same 
energy and therefore the energy can be used to measure the calculation accuracy of 
the approximated Hilbert transform. 

Hilbert Transform — Definition: Signal xy (t) obtained from a real signal x(t) 
by shifting the phase angles of all spectral components of x(t) by +90 degrees is 
known as the Hilbert transform of the signal. That is, 


xy(t) = Ji aO a, (5.19) 


eat 


and the inverse Hilbert transform is given by, 


x(t) = -1 J y (5.20) 


t—T 


5.41 Hilbert Transform as a Filter 


The Hilbert transform, x(t), defined in the time domain is the convolution 
between the Hilbert transformer 4 and the function x(t). That is, 


1 
xut) = x(t) ® = (5.21) 
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Figure 5.5. Impulse response (Top), magnitude response (Middle) and phase response 
(Bottom) of the Hilbert transformer. 


where ® denotes the convolution operation and 4 is the Hilbert transform oper- 


ator. We have, 


1 
— e —jsgn(f), (5.22) 
ut 
Fourier transform pair, where 
eiz? f>0 
— jsgn(f)= 740 f=0 (5.23) 
eit? fF <0 


The impulse response, h(t) = +, of the Hilbert transform operator and the corre- 
sponding frequency response are shown in Fig. 5.5. It can be seen that the impulse 
response has a discontinuity at t = 0 and it is inversely proportional to t. Its mag- 
nitude response |H(f)| is constant (= 1) throughout the frequencies. The phase 
response is — 3 for positive values of the frequencies and + 7 for negative values of 
the frequencies. Also, there is a discontinuity of the phase response at f = 0. 


Example: The Hilbert transform of rectangular pulse train is shown in Fig. 5.6. 
As can be seen from the figure, the Hilbert transform becomes infinite at the dis- 


continuities of the rectangular pulse train. 
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Figure 5.6. Hilbert transform of a rectangular pulse train. 


5.4.2 Properties of Hilbert Transform 


e The Hilbert transform of a constant is zero. 

e The Hilbert transform of a Hilbert transform of a function is the negative of 
the original function. 

e A function and its Hilbert transform are orthogonal over the infinite interval. 

e The Hilbert transform of a real function is a real function. 

e The Hilbert transform of a sine function is a cosine function, the Hilbert 
transform of a cosine function is the negative of the sine function. 

e The Hilbert transform of an even function is an odd function and the Hilbert 
transform of an odd function is an even function. 

e The Hilbert transform of the convolution of the two functions is the convo- 
lution of one with the Hilbert transform of the other. 


e Linearity: 
H{axı(t) + bx2(t)} = axyı (t) + bxy2(t), (5.24) 


where a and b are scalar constants and H is the Hilbert transform operator. 


e Time shift: 
H{x(t + to)} = xu (t + to). (5.25) 
e Applying two times the Hilbert transform gives the original signal: 
H{H{x (t)}} = —x (t). (5.26) 


e The inverse Hilbert transform: 


x(t) = Hx O} = -f r 


—1 
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e Even/Odd Property: 


x(t) even & xy (t) odd 


x(t) odd & xy(t) even (5.28) 
© Conservation of energy: 
J i x (t)dt = | i x3 (@)dt. (5.29) 
e Orthogonality: 
D x(t)xy (t)dt = 0. (5.30) 
e Time-derivative: 
H [=| = ETO (5.31) 
e Convolution: 
H {x(t) 8 y0) = xt) @ ya) = xg lt) 8 yO). (5.32) 


5.5 Analytic Signals 


An analytic signal (denoted as zx(t) of an analog signal x(t)) is a signal whose 
spectrum is one sided. For analog signals, this means that their spectrum is = 0 for 
f > Oor f < 0. Analytic discrete time signals have a spectrum which is = 0 
for -$ < f < 0 and in the corresponding parts of the periodic spectrum, or 
0< f< & and the corresponding parts of the periodic spectrum. This condition 
for an analytic signal gives the connection between the real and imaginary parts of 
the complex signal. 


5.51 Analytic Analog Signals 


Ifa real signal x(t) with frequency spectrum X (f) is taken as a starting point, then 
the following relations will be valid for the respective analytic signal, z(t), and its 
spectrum: 


2X(f) forf >0 
zalt) S Zf) =X for f =0 (5.33) 
0 for f <0. 
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This relation can be expressed in a more compact form as”: 


Zx(f) =[1+ sgn(f)] X(f). (5.34) 


Since Sgn(f) is the Fourier spectrum of the function j4 (j a © sgn(f)), 
then the above equation is equivalent to: 


1 
Zx(t) = (3 + ix) Q x(t). (5.35) 
Here, we introduce the signal xy (t), known as the Hilbert transform of x(t) and 
given by, 
1 
xy(t) = x(t) 8 —. (5.36) 
mt 
It can be seen that 
Zx(t) = x(t) + jxp (t). (5.37) 


Notice that the complex conjugate z* (t) is also analytic with spectrum given by, 


0 for f > 0 
ZfV=4XG). for f =0 (5.38) 
2X(f) for f <0. 


and that consequently: 
x(t) = ; (zx (t) +23@). (5.39) 
If zx (t) is written in the form, 
zx (t) = az (tje O (5.40) 
then 
x(t) = a; (t) cos(6:(t)) and xy (t) = az(t) sin(0:(t)). (5.41) 


If the analytic signal zx (t) is filtered using a filter with real impulse response, 
then the output signal y(t) will be: 


Y(t) = hlt) O zx) = h4) O xt) + jh) @ xn). (5.42) 


2. $gn(t) returns the sign of the argument. It returns +1 ift > 0, —1 ift < 0, and 0 if t = 0. 
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If the Hilbert transform of h(t) is denoted by A y (t), then one gets: 
y(t) = x(t) @ (A(t) + jhn t)) =x) zalt), (5.43) 


where zy (t) is the Hilbert transform of h(t). 

This operation is sometimes useful when one wants to work with analytic signals, 
but has only a real signal to start with. Notice that h y (t) is usually noncausal. 

Using the symmetry property of the Fourier transform, it can be shown that the 
real and imaginary parts of the spectrum of a real signal form a Hilbert pair, that is 
each can be obtained from the other using a Hilbert transform. This, and a number 
of other properties of the Hilbert transform can be found in the Section 5.4.2. The 
symbol H is used to denote the Hilbert transform, i.e., xy (t) = H{x(t)}. 


5.5.2 Analytic Discrete-time Signals 


Ifa real discrete-time signal x[n] <> X (f) is used as a basis, then the corresponding 
analytic signal’ z,[n] will be given as 


2X(f) for pfs < f <Qpt+H# 
ZxnN] © Z.(f) = 4X(f) for f = pfs (5.44) 


0 otherwise 


where p is an integer and fs is the sampling frequency. Let us consider the following 
spectrum: 


+1 for pf, < f <Qp+1)Ẹ 
zxIn] © Zx(f) = 40 for f = pfs (5.45) 
-1 forQp-# <f < pfs 
The discrete-time signal that corresponds to this spectrum is 
py 2 T 
j sin (n Ai (5.46) 


It follows directly that 


2 
zx[n] = (aim + A sin? (3)) @ x[n]. (5.47) 


3. The use of the term analytic in relation to discrete-time signals leads to mathematical difficulties. Many of 
them can, however, be circumvented if one applies the fact, that a given digital signal corresponds to an 
equivalent analog signal. 
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By the analogy with the relation in Eqn. (5.36), we denote the signal 


2 
xin] = xin] ® j— sin? (n *) (5.48) 


as the Hilbert transform of x[n]. The relation between z,[n], x[n] and xy[n] is 
given by, 


Zx[n] = x[n] + jxa[n]. (5.49) 
Similar to Section 10.3.7, it can be shown that 
hin] 8 za[n] = x[n] 8 zaln], (5.50) 


where 


2 
za[n] = h[n] + jhy[n] = h[n] + jh[n] 8 — sin? (n=). (5.51) 
nw 2: 


5.6 Instantaneous Amplitude and Frequency 


Let us consider the band-limited real signal g(t) with a band width fg. The ampli- 
tude spectrum of such a signal is shown in the left subplot of Fig. 5.7. For this par- 
ticular case, an analytic signal can be created by frequency-shifting the spectrum of 
the signal with an offset fo, where | fol > fg. This operation is illustrated in the 
second sub-plot of Fig. 5.7. In other words, we create a signal z(t) = g(t)e/?*/0", 
which is analytic if | fo] > fg. It can be represented as real and imaginary parts as: 


zo(t) = go(t) + jgon(t), (5.52) 


where goy (t) is the Hilbert transform of the real signal go(t) = g(t) cos(2z fot). 
Using the Euler’s relations, we find that 


golt) = g(t) cos(27 fot) and gop (t) = g(t) sin(2z fot). (5.53) 


If we assume that g(t) gets only non-negative values (g(t) > 0), then it follows 
immediately that: 


az(t) = g(t) and 0z(t) = 27 fot, (5.54) 


where, az(t) is the envelope of the analytic signal and 0; (t) is the phase of the 
analytic signal. The instantaneous amplitude of zo(t) is then g(t), and the value 


0, (t)/2x = = He) is said to be the instantaneous frequency of the signal. 
An example of an analytic analog signal and its various parameters are shown in 
Fig. 5.8. 
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Figure 5.7. Construction of an analytic signal. 


(a) 

1 
o 
ne] 
2 

a 0 
E 
< 

-1 

0 1 
Time (seconds) 
(c) 

1 
oO 
ke] 
= 

= 0 
E 
xt 

-1 

0 1 
Time (seconds) 


w 


to 


Amplitude 


(b) 
1 
-1 
0 1 
Time (seconds) 


(d) 


v e 


Angle (Radians) 
© o 


k 
(= 


1 
Time (seconds) 


w 


bo 


Figure 5.8. Instantaneous amplitude and phase for an analytic signal; (a) the analytic sig- 
nal, go(t), (b) Signal and its envelope (or instantaneous amplitude) (a; (rt) in red), (c) Hilbert 


transform, gon (t), and (d) Instantaneous phase, 6-(r). 


In the case that g(t) can be both positive and negative, the amplitude a;(t) 
will be the absolute value of g(t), i.e., az(t) = |g(t)|. The phase 6,(t) of such 
analytic signal will jump from +7 in those time instances, when g(t) changes its 
sign. The first derivative with respect to time, 0, (t), will still be proportional to the 
instantaneous frequency, except for the points of discontinuity. This is illustrated 


in Fig. 5.9. 
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Figure 5.9. Instantaneous amplitude and phase for an analytic signal with a point of dis- 
continuity; (a) the analytic signal, go(t), (6) Signal and its envelope (or instantaneous 
amplitude) (a,(t) in red), (c) Hilbert transform, gop (t), and (d) Instantaneous phase, 6-(t). 


This figure clearly shows the phase jump in the instantaneous phase plot 
(Fig. 5.9(d)) at the point of discontinuity in the analytic signal. 

The concepts of instantaneous amplitude and frequency can be transferred for- 
mally to the typical case, in which the analytic signal z(t) is given in the form 
a;(t)e/®, Figure 5.10 shows an example in which 0;(t) varies non-linearly in 
time. 

These concepts are also applied to non-analytic signals, and the same can be 
defined for discrete-time signals as well. The phase of the signal is given by: 


0; (t) = arctan (=). (5.55) 


The instantaneous frequency is proportional to the derivative of the phase with 
respect to time, and can be found from: 


ZONE (eee) (5.56) 


2m 2r x2(t) + x30) 
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Figure 5.10. Instantaneous amplitude and phase for an analytic signal with non-linear 
variation of the phase (6-(r)); (a) the analytic signal, go(r), (b) Signal and its envelope (or 
instantaneous amplitude) (a(t) in red), (c) Hilbert transform, gou (t), and (d) Instantaneous 
phase, 6.(t). 


5.7 


Concluding Remarks 


Introduced both the analog and discrete complex signals. 

Fourier transform of complex signals were discussed in detail. 

Theory of linear processing of complex signals introduced. 

Hilbert transform and its properties were discussed in detail. 

The concept of analytic signals and instantaneous amplitude and frequency 
were also introduced. 


Exercises 


5.1. Consider the real signal x(t) with spectrum X (f). Some properties of the 


Hilbert transform y(t) = H{x(t)} = 1 ® x(t) are to be investigated. 

The impulse response of the Hilbert transformer is indicated by h(t). 

(a) Give H(f) < h(t) and sketch the magnitude and phase of H (f). 
How does the Hilbert transform affect |X (f)| and arg{X (f)}? 
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(b) Is y(t) real, imaginary or complex? What symmetry does the Hilbert 
transform of the even part xe(t) and the odd part x(t) have? 
(c) Compute the Hilbert transform of the Fourier series 


A [0.0] 
x) = a + X [ag cos( fokt) + br sin(fokt)], fo > 0. 
k=1 


5.2. Given the signal x(t) = bs x eee and its Hilbert transform xy (t) = 

Hix}. l 

(a) Calculate and sketch X(f) © x(t). (Note: use the multiplication 
theorem of the Fourier transform.) 

(b) Determine Xy (f) © xy (t) graphically and calculate xy (t). (Note: 
consider the discussion on the Hilbert transform in time-domain and 
frequency-domain) 

(c) Let xg(t) = x(t) + jxu(t). Which special property exhibits 
Xal f) © Xalt)? 

(d) Calculate X4(f) formally in dependence on X (f). 

5.3. For Qo > 0, calculate the Hilbert transform in the frequency domain for 
the following functions: 

(a) ei Qot ; 

(b) si nQot 3 

(c) cos Qot, and 

(d) cos 2Qot. 

5.4. What is the connection between the energy of a signal x(t) and its Hilbert 
transformed signal xy (t)? Assume that the signal has no DC component. 


DOT: 10.1561/978168083979 1.ch6 


Analog Systems 


In Chapters 1 to 4, we studied about signals and representation of signals in time 
and frequency domains. The focus of this chapter is analog systems that work with 
these signals. We will find that Fourier transform (FT) is a very useful tool in work- 
ing with and understanding systems. 

In a general sense, we may define a system as anything that performs a function. 
That is, it operates on something and produces something else. We may also say that a 
system is anything that responds (by producing an output) when excited or stimulated 
(by an input). The schematic of a system with input signal x(t) and output signal 
y(t) is shown in Figure 6.1. A system can be an electrical system (e.g., electrical 
circuits), a mechanical system (e.g., automobile engines), a biological system (e.g., 
human vocal tract or heart or brain, etc.), a computer system, etc. 

In this chapter, we will discuss the following topics in detail. 

e Classification of systems. 

e Characterization (time-domain and frequency-domain) of systems, leading 

to the concepts of convolution, impulse response and frequency response. 

e Processing and analysis of signals using systems (filters). 

e Determination of impulse response or frequency response of systems, and 

output of a system for given input, etc. 

e Importance of sinusoids and FT in the study of systems. 
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Figure 6.1. A system with input signal x(t) and output signal y(t). 


6.1 Classification of Systems 


We give below a few ways of classifying systems. 


6.11 Continuous-Time or Discrete-Time Systems 


Just as we have continuous-time and discrete-time signals, we can also define 
continuous-time and discrete-time systems. A continuous-time system oper- 
ates on continuous-time inputs and produces continuous-time outputs (e.g., 
mobile-phone, communication channel, etc.). Similarly, a discrete-time system oper- 
ates on discrete-time inputs and produces discrete-time outputs (e.g., computers, 
digital filters, etc.). In this chapter, we will only be considering continuous-time 
systems. 


6.1.2 Time-Invariant Systems 


Let y(t) be the output of a system when the input is x(t). Then, the system is said 
to be time-invariant if its output is y(t — to) when the input is x(t — to). That is, 
in time-invariant systems, a time-shift in the input results in the same time-shift in its 
output, without changing the shape of the output. 


6.1.3 Causal Systems 


A system is said to be causal if its output at any instant tọ depends on its input x (t) 
for time t < to only. That is, the output of a causal system depends only on the present 
and past values of its input. 


6.1.4 Linear or Non-linear Systems 


Let yı (t) and y2(t) be the outputs of a system when the inputs are xı (t) and x2(f), 
respectively. Then, the system is said to be linear if its output is ayı (t) + Py2(t) 
(where a and £ are scalars) when the input is axı (t)+fx2(t). That is, /inear systems 
obey the principle of superposition. Non-linear systems do not obey the principle of 
superposition. 
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6.2 Description of a System 


Consider a linear system whose output is y(t) when the input is x(t). If we want 
to use this system in any particular application, we need to know beforehand what 
function this system is performing. In other words, we need to have a description of 
the system. There are different ways to describe a system, some of which are listed 
below. 


6.21 Input-Output Equation 


We may describe a system by stating how the output is related to its input. For exam- 
ple, we have 


y(t) = 7x(t) + 8x(t — 3). (6.1) 


6.2.2 Frequency Response 


We may describe a system by specifying its frequency response. Frequency response 
(denoted by H ( f )) is given by the ratio of the Fourier transforms of the output to input. 
For example, the frequency response of the system described in Eq. (6.1) is given by! 


H(f)= YY) L74879, (6.2) 


X(f) 
6.2.3 Impulse Response 


We may describe a system by specifying its impulse response. Impulse response 
(denoted by h(t)) of a system is its response (or output) when the input is an impulse 
O(t) at time t = 0. For example, the impulse response of the system described in 


Eq. (6.1) is given by? 
A(t) = yY@Olx@=say) = 761) + 8t — 3). (6.3) 


Recall that the frequency response H(f) of a system is the FT of its impulse response 
h(t). Therefore, the impulse response of a system can be obtained by determining the 


1. To determine the FT Y(f) of y(t) given by Eq. (6.1), apply the Anearity property of FT. That is, 
F [y(t)] = F [7x(t) + 8x(¢ — 3)] = 7F [x(t)] + 8F [x(t — 3)] 
> YP) = TXF) + 8PX) = [7+ 8e] XP) 


since F [x(t — to)] = e712" X ( f). Thus, we have Y (f) = H(f)X(f) for linear systems. 


N 


The notation y(t)|,()=0() Means “y(t) when x(t) = d(t)”. 
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Figure 6.2. RC circuit. 


inverse FT of its frequency response. Note that Eq. (6.2) is the FT of Eq. (6.3) since 
F [d(t — to)] = e JM. 

Note that from the linear system theory, the output y(t) of a system can be obtained 
by convolving the input x(t) with its impulse response h(t). That is, we have? 


y(t) = x(t) 8 h(t) = L x(t)h(t — t)dt (6.4a) 


CO 
= f h(t)x(t — t)dt. (6.4b) 
—Co 

§ Determine the output y(t) of the system specified by Eqs. (6.1)—(6.3) for the following 
inputs: x(t) = 10 for allt, x(t) = 3e/0", x(t) = 10 + 3 cos(Qor). 

§ In the RC-circuit (Fig. 6.2), note that y(t) = x(t) — Ri (t) where i (t) is the current 
flowing through the resistor R. Noting thati(t) = C D0, determine the frequency response 
of the circuit. 


6.3 Why Study of Systems is Important? 


In many practical applications, we will need to deal with systems and their inputs 
and outputs. Broadly speaking, in most of the practical applications, we will need 
to do one or more of the following three tasks. 


6.3.1 System Identification 


This deals with acquiring the knowledge of the system. For example, to properly design 
the transmitter and receiver in a communication system, we should have a very 


3. For the sake of clarity, I am using the notation ‘®’ to denote convolution, though some text books uses ‘*’ 
to denote convolution. 
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good understanding of the channel (or medium) through which the signal propa- 
gates. The channel may be described by means of its frequency response or impulse 
response (ignoring the noise). So, as a first step to designing the transmitter/re- 
ceiver, we need to develop a mechanism to obtain the channel characteristics. This 
may be done, for example, by transmitting a known signal, x(t) and measuring the 
corresponding output, y(t). From x(t) and y(t), H(f), the system function can 
be found as, H (f) = wai. thus identifying the system. 


6.3.2 Output Evaluation 


This deals with evaluating the output (y(t)) of a system (for specific inputs, x (t)) 
if its frequency response (H(f)) or impulse response (h(t)) is known. This can be 
done either using Y (f) = X(f)H({f) or using the convolution operation as in 
Eq. (6.4). In the above example of a communication system, once we know the 
channel, we can use it to simulate the transmission of various signals and understand 
how the output will be for each of these signals. This will help us to design the 
receiver and signals. 


6.3.3 Input Estimation 


This deals with estimating the input, x(t), of a system if its output, y(t) and the 
knowledge of the frequency response, H(f) or impulse response, h(t) of the system are 
given. This may be done, for example, using X(f) = ane: We could use such 
an approach in the above example of a communication system to determine the 
transmitted signal. 

The topics covered in this chapter equip us with the basic knowledge necessary 
to understand and perform the above tasks. 


6.4 Frequency Response 


Since Y (f) = H(f)X(f), we can write 


YOI = IEO IX; AA) =A) +P (6.5) 


where 0)(f), Ox(f) and On(f) are the phase characteristics of Y (f), X(f) and 
H(f), respectively. Equation (6.5) clearly shows how the system is affecting the 
input. In other words, we can shape the spectrum of a signal x (t) by passing this signal 
through an appropriately chosen filter. For example, consider a signal x(t) whose 
spectrum is as shown in Figure 6.3(a). Let us specify two filters Hı (f) and Ho(f) 
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as‘ (see Figures 6.3(b) and (c)) 


_ fl for|fl < 30 
m= fo for |f| > 30. (6.6) 


1.75 for 80 < |f| < 95 


lA) = l for 80 > |f| > 95. (6.7) 


Let yı (t) and y2(t) be the outputs of these filters when x(t) is applied to their 
inputs. Then, we get 


Yi(f) = Ai(f)X(f) and Yf) = Ao(f)X(f). (6.8) 
With Hı(f) and H2(f) given as above, we find that 


_ {X(f)  for| fl < 30 

M1) = l for | f| > 30. an 
_ [1.75X(F) for80< |f] < 95 

rf) = l for 80 > |f| > 95. coo) 


Thus, we find that using the filters Hı (f) and H2(f), we are able to extract different 
frequency regions in the spectrum of the input signal x(t) (see Figures 6.3(d) and (e)). 

The above principle can be generalized to transform a given signal x(t) into 
another signal y(t) with any specific characteristics we desire. What we need to do 
is to select an appropriate filter H(f) such that Y(f) = H(f)X(f) satisfies our 


requirements. To illustrate this, we consider an example below. 


Example: In an experiment aimed at recording a particular electrical activity of the 
human body, the signal obtained from the bio-medical sensor is x(t) given by 


x(t) =d(t) + p(t) + nt). 


Here, d(t) is the desired bio-medical signal and its spectrum lies in the frequency 
band |f| < 30, p(t) is the 50 Hz power-line interference signal whose spectrum 
consists of two lines at f = +50 Hz, and n (t) is a noise pick-up whose spectrum 
lies in the band |f| < 300. We want to use some filters to clean up the signal x(t) 
(i.e., reject the interference and reduce the noise) so as to obtain a better estimate ofd (t). 


Solution: Because the spectrum of the interference p(t) lies outside the spectrum of 


the desired signal d (t), we can easily reject this interference by passing x (t) through 


4. The notation 80 < |f| < 95 means —95 < f < —80 and 80 < f < 95. Further, | f| < 30 means 
—30 < f < 30, and |f] > 30 means —30 > f > 30. 
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XI! 56 
(a) 
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IHC) 175 
(c) 
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(d) 
-30 0 30 f 
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Figure 6.3. Example of a signal x(t) being filtered by filters Hı (f) and H2(f), resulting in 
outputs y(t) and y2(t), respectively. 


the filter Hı (f) specified in Eq. (6.6). Let yı (t) be the resulting output. Then, 
yi(t) satisfies Eq. (6.9). Since Yı (f) is zero for |f| > 30, we find that filtering 
by H1(f) also helps to reject all the noise that lies in the frequency region 30 < 
|f| < 300. Thus, we can write the output y1 (t) as’ 


yt) =d) +A), 


where A(t) is the result of filtering the noise n (t) with Hı (f). Further, the spectrum 
of A(t) is now limited to |f| < 30, from |f| < 300. Thus, we find that the 
output signal yı (t) is a much cleaner version compared to the original recorded signal 


x(t) since the interference has been totally rejected and the noise has been significantly 
reduced. 


5. Note that Yi (f) = MAXA = MIDA + POP ANA = MAADE) + MAPE) + 
A (f)N(f) = D(f) +0+ N(f) where N(f) = Mi (f)N(f). Taking inverse FT, we get yı (t). 
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§ Assume that a signal x(t) is passed separately through two filters whose outputs are 
given by 


y(t) =x(t) +x¢—-T) (6.11a) 
z(t) = x(t) —x(t — T) (6.11b) 
where T denotes a time-shift. Determine the expressions for the impulse responses and fre- 
quency responses of the two filters generating y(t) and z(t). Verify that the first filter atten- 


uates the signal x(t) around the frequency 1/(2T) Hz, and the second filter attenuates the 
signal x(t) around the frequency! 0 Hz. 


6.5 Sinusoidal Input to Linear Systems 


Let x(t) and y(t) be the input and output, respectively, of a linear system whose 
frequency response is given by H(f). Let us choose the input to be a complex 
sinusoid given by 


x(t) = Age Cr for) > X(f) = Age 5(f — fo) (6.12) 


where Ao, fo and 9 are the amplitude, frequency and phase, respectively, of the 
sinusoid. Then, the filter output is given by 


Y(f) = X(f)A(f) = Ave! d(f — fo)H(f) 


= Age! H(fo)d(f — fo) (6.13) 
=> y(t) = Ape! H ( foje?” Po = H(fo) [Ane Orre] 

= H(fo)x(t) (6.14) 

= Aol H (fo)le/ (2r fot+O0+6n (fo)) (6.15) 


where On ( fo) is the phase of H ( fo), i.e., H(fo) = |H (fo) |e/% 0), We note the 
following from Eqs. (6.13)—(6.15): 


e When the input of a linear system is a sinusoid of frequency fo, the resulting 
output is also a sinusoid at the same frequency fo, with a different amplitude 
and phase. 

e Amplitude and phase of the output sinusoid are Ao| H (fo)| and Oo + On (fo), 
respectively. That is, the input amplitude and phase are changed by the 


6. To determine the impulse responses, set the input to 0(t). Show that h1 (t) = (t) + d(@t — T), Mi(f) 
1+eP7FT, [Ey (f)? = 4 co? (a fT), and ho(t) = 6(t)—5(t—T), HS) = 1-e PI, |Ha (fF)? 
4 sin? (x fT). 
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magnitude and phase, respectively, of the filter frequency response H (f) at 
f= fo. 
6.5.1 Generalization to Multiple Sinusoids 


We now generalize the above result to the case where the input x(t) consists of a 
sum of M sinusoids rather than one sinusoid. That is, 


M 
x)= Ae ART (6.16) 
i=l 


M 
=> X(f)=)> Ad - fi) (6.17) 


i=l 


where Aj, f; and 6; are the amplitude, frequency and phase, respectively, of the i” 
sinusoid. The filter output is given by, 


M 
Y(f)=X(PH(f) = >) Aida — fy H(/) 


i=l 


M 
=J Ae HOG = fi) (6.18) 
i=l 
M 
=> y= DAH (fje Ohto) (6.19) 
i=l 
M 
= > Ail H (foje C7 fF + FD) (6.20) 
i=l 


where On (fi) is the phase of H ( fi), i.e., H (fi) = |H (fi lef), Based on these 


results, we can conclude the following. 


§ The output of a linear system cannot contain a frequency that is not present at its input. 


6.6 Partial Fraction Approach 


It is often necessary for us to find the time-domain output y(t) of a system from 
its FT, Y (f) or the impulse response h(t) of a system from its frequency response 
H(f). This is a trivial task if the frequency-domain expression looks like the ones 
given in Tables 4.1 or 4.2 (see Section 17.6). However, often, the expressions are 
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not as simple as these. In such cases, the method of partial fraction is used to express 
a complicated expression in the form of a sum of several simple expressions whose inverse 
transforms can be found based on table look-up. 

Let Y (f) be a complicated expression whose inverse FT we want to find. The 
method of partial fraction determines scalars @1, @2, +++, @m such that Y (f) can 
be written as 


Y(f) =Y (f) + a2¥2(f) +--+ + amYm(f) (6.21) 


where Y1(f), Y2(f), -+ -, Ym(f) are simple expressions whose inverse transforms 
are known. Then, we can get the inverse FT of Y(f) as, 


y(t) = aiyi(t) + a2y20) + +++ + amYm(t) (6.22) 
where y; (t) is the inverse FT of Y; (f) fori = 1,2,...,m. 
Example: As an example, let us consider the problem where we have 


1 
(+ jQ)3 4+ jQ) 


¥(f)= (6.23) 


; ; F 1 1 eos 
While we know the inverse Fourier transforms of To and 37 7O it is not easy 
to determine the inverse Fourier transform of their product. So, express Y (f) as a 
sum of these easy factors as 


1 a b 


(+ fQ)3 +j) 14+j7Q 34+ 70 ( 


Y(f) 


where the scalars a and b are to be determined. To determine a and b, combine 
the last two terms on the right-hand-side (RHS) of Eq. (6.24) to result in 


1 _ 3atbt+ jQ(a+b) 
(1+ jQB4+j7Q) (14+ jQ)B+ jQ) © 


(6.25) 


Since the denominators are the same on both sides of Eq. (6.25), the numerators also 
must be the same on both sides. Noting that the numerator on RHS is a polynomial 
in the variable Q, we can equate the coefficients of QP, Q!, Q?, .-- on both sides. 
Doing this, we get 


3a+b=1 and jJ(a+b)=0. (6.26) 
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Solving these two equations for a and b, we geta = 1/2 andb = —1/2. Therefore, 
we get from Eq. (6.24) 


0.5 0.5 
Wf) = 1+jQ 34+ jQ oa 
=> y(t) =0.5e u(t) —0.5e7* u(t), (6.28) 


since e u(t) (with c > 0) is the inverse FT of 1/(c + jQ). 


6.7 Convolution 


The output ofa linear time invariant (LTI) system for any input, x(t), can be found 
by convolution operation between the input, x(t) and the system impulse response 
(or system function), A(t). Consider a linear system with frequency response 
H(f) < h(t). Then, we know that its output (in frequency-domain) is given 
by, 


Y(F) = X(f)H(f), (6.29) 


where X(f) is the FT of the input, x(t). The inverse FT of both sides of Eq. (6.29) 

is given by the convolution of the filter impulse response h(t) with the input x(t) as, 
y(t) =x) ht) 

z. x(t)h(t — t)dt = f h(t)x(t — t)dt. (6.30) 


It is also to be noted that convolution is commutative. This implies that y(t) = 
h(t) @x(t) = x(t) h(t). This means that the order in which these two functions 
convoluted does not influence the output. 


6.71 Convolution Explained 


The convolution operation is explained briefly in the following: 


rT+Ar t 


Figure 6.4. Convolution explained. 
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Let x(t) in Fig. 6.5 be a continuous time function of time, which is input to 
a LTI system. The output y(t) of the system is the convolution of x(t) with the 
system function A(t). This is explained here. 

At time T, consider the interval [t, t + Art]. For sufficiently small Az, the area 
under x(t) inside the interval (shaded area in Fig. 6.5) can be approximated by an 
impulse function of strength x(7)At. 

By definition, the response of a LTI system to an unit impulse att = 0 (i.e., 
ô(t)) is h(t). Therefore, the response of the system to an impulse (delta) function 
of strength x(t)At occurring at t = T is, 


Ay(t) = x(t)h(t — t)At. (6.31) 


In the limiting case as At — O, apply the principle of superposition to obtain 
the overall system response to the input x (t) as, 


CO CO 

y(t) = f dy(t) = | x(t)h(t — t)dt. (6.32) 
—00 J —OO 

This is the convolution operation and is denoted as y(t) = x(t) * h(t) or y(t) = 

x(t) @ h(t). 

We can get the second integral expression from the first integral in Eq. (6.30) by 
applying a change of variables of the form u = t — t. Note that the integration is 
done with respect to the variable t. In other words, inside the integral, t acts like a 
constant. For example, the expression for computing y(t) at instant t = 2 is 


y(2) = a h(t)x(2 — t)dī. (6.33) 
Let us examine x (t — T). 
Let z(t) =x(-7). (6.34) 
Then, x(t—71) =x (-—(t —1t)) = z(t —- 1) (6.35) 
=> y(t) a] z(t —t)h(r)dt. (6.36) 


Eqs. (6.34)—(6.36) implies the following approach to compute the filter output 
y(t) for any value of t. 


e First, construct z(t) by time-reversing x(t). 

e Ift > 0, then x(t — T) is obtained by shifting z(t) to the right by t. That 
is, shift x(— T) to the right by t. 

e Ift <0, then x(t — T) is obtained by shifting z(z) to the left by t. That is, 
shift x(—T) to the left by t. 
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e Compute y(t) by integrating the product z(t — t)h(r) over the complete 
range of t for which this product is non-zero. 


h(t) 


Figure 6.5. Illustration of the convolution operation of two functions in the time domain. 


Eqs. (6.29) and (6.30) show that multiplying two signals in frequency-domain is 
equivalent to convolving these signals in time-domain.’ Thus, we have two approaches 
for computing the filter output y (t) given x(t) and A(t), and are given below. 


e Use the convolution integral given by Eq. (6.30). 
e Determine the Fourier transforms X(f) and H(f), and find the inverse 
transform of the product X(f)H(f). 


We can use either of these approaches, depending on which is easier to implement 
in the given application/problem. 


7. Similarly, multiplying two signals in time-domain is equivalent to convolving them in frequency-domain. 
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A graphical illustration of the convolution operation of two functions (h(t) and 
x(t)) is given in Fig. 6.5. 


6.8 Shifting Property of Impulse Function 


Let us consider the convolution of a signal x(t) with an impulse 6(t — to) located 
at t = to. We obtain, 


x(t) ® d(t — to) = [ x(t — t)d(t — to)dt, 


D x(t — to)d(t — to)dt, 


I 


x(t — w f O(t — to)dt, 
= x(t — to), (6.37) 


where we used the sampling property of impulse function to get the second line 
and the unit-area property of impulse function to get the last line (see Eqs. (4.59)— 
(4.61) in Chapter 4). Equation (6.37) implies that convolving a signal x(t) with an 
impulse 0(t — to) results in shifting the signal to the location of the impulse. This is 
known as the shifting property of impulse function. 

Using this property, it is easy for us to examine what happens in frequency-domain 
when we do sampling in time-domain. Let us sample a continuous-time signal x(t) at 


the rate of fs = 1/T; samples/second. (see Eqs. (4.59)—(4.61) in Chapter 4). This 
[0,6] 


is done by multiplying x (t) with a periodic impulse train i (t) = > o(t — nT;) 


of period Ty, resulting in, a 
y(t) = x(t) xilt) = x(t) > o(t — nT;). (6.38) 
FT of the impulse train is given by, 
If) = FEO] = fs 5 O(f — kfs). (6.39) 


k=—0o 
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FT of the sampled signal y(t) can be obtained by convolving X (f) with I (f), 


resulting in 


V(f)=X(P@I(f)=X(f)® Ẹ S oF - in) 


k=—0o 


=f >) KAB —kfs)] 


k=—0o 
=fs >) X(f-kfi) 
k=—0oO 
= fsb +X +2fs) +XF + fs)+ X(f) 
EAT = fs) +X(SF = 2 fy) Pe]. (6.40) 


Thus, Y (f) is periodic with period fs, and is obtained by adding periodically shifted 
copies of X(f). See Fig. 6.6 for illustration of these spectra. It can be seen that 
the spectra of the sampled signal repeats (with a period, fs) on either side of the 
frequency axis and are scaled by the sampling frequency, fs. 


§ Based on Figure 6.6, suggest an approach to reconstruct the analog signal x(t) from its 
samples. What is the minimum possible sampling frequency? 


IX(f)| 


=B 0 B f 


YA) 


FAIX + fs) FIXO) FIXE — Fl 


Figure 6.6. Spectra of (a) continuous-time signal x(t), (0) sampled version of x(t) with 
sampling frequency fs. 
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6.9 Concluding Remarks 


We can make the following concluding remarks based on the material presented 
above. 


e Fourier transform (FT) is a very useful (and powerful) tool in the study of 
systems. 

e Frequency response of a system specifies how the system is going to shape the 
input signal. 

e The output of a linear system cannot contain a frequency that is not present 
in its input. 

e The output of a linear system can be determined either using time-domain 
computations (i.e., convolution of input signal x(t) and system impulse 
response h(t)) or using frequency-domain computations (i.e., multiplying 
the Fourier transforms of x(t) and h(t), and finding the inverse FT of the 
product). 

e Partial fraction approach is very useful to determine the inverse Fourier trans- 
forms of complicated frequency-domain expressions. 


Exercises 


6.1. (a) An analog linear system has an impulse response h(t) = e~“u(t), 
where a is a real constant and u(t) is a unit step function. Use con- 
volution to find the response of the system (y(f)) to a unit step input 
(i.e., x(t) = u(t), here x(t) denotes the input to the system). 

(b) Sketch the magnitude and phase response of the system. Determine 
the 3dB bandwidth of the system. 

6.2. Determine the convolution of x(t) and ug(t), where x(t) is any signal. 
Derive the expression for the convolution of x(t) with a time-shifted unit 
step function u(t — to), where fg is the time delay. 

6.3. The impulse response of an analog system is given by h(t) = u(t) — 
u(t — 2). Use convolution to find the response of this system to an input 
x(t) = u(t) — u(t — 3). 

6.4. (a) An engineer is contemplating the use of a Gaussian pulse of the form 
x(t) = a. where c is a suitable constant related to the pulse 
width, for transmitting digital information in a mobile communi- 
cation system. The engineer finds that the spectrum of this pulse is 
X(f)= be- Tef} where b is a constant and it depends on c. Sketch 
the pulse and its spectrum for c = 5. Using energy argument or 
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6.5. 


6.6. 


Parseval’s theorem, derive a formula that can be used for calculating 
the constant b from c. Derive equations from which the —3 dB pulse 
width and the —3 dB bandwidth can be found. 

(b) The Gaussian pulse in Question 6.4(a) is convolved with itself. Show 
that the resulting waveform is also Gaussian. Has the —3 dB pulse 
width increased? If yes, by how much? 

An engineer designed a filter whose impulse response A(t) is given by (at), 

where a is a real positive scalar. 


(a) When the engineer passed the signal x(t) = cos(200zt) through the 
designed filter, he observed that the filter output, y(t), becomes zero 
(for all t) for some choice of a. For some other choice of a, the output 
becomes a scaled version of the input (i.e., y(t) = x(t), where £ is 
a real scalar). Analyse this problem and determine the ranges of values 
of a such that the output will be a scaled version of the input. What 
is the expression for p? 

(b) Assume that a is chosen from the range determined from Question 
(a). Determine the power and energy of the input and output of the 
filter. Plot the magnitude and phase spectra of the input and output 
of the filter. 

In this problem, we consider a system for measuring the speed of objects. 

The operation is as follows. The system sends a radio-frequency (RF) pulse 

p(t), like the one shown in Fig. P6.1 below: 


Figure P6.1. RF pulse (p(t)). 


The signal is reflected by the object, whose velocity is being measured and 
the echo arrives at the receiver at time fg. The received signal is given by: 


g(t) =a x plat — to). 


The shape of the signal is modified due to the motion of the object. 
The constant @ is given by: 


2v c+ 2w 
a = 1 + — = 3 
c c 
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where v is the speed of the object and c is the speed of propagation of the 
ultrasound signal which is assumed to be much larger than the speed of 
the object which is being measured, i.e., c >> v. a and fo are positive real 
constants. The RF pulse p(t) is given by: 


x M 
He Fae for O<t< T 


0 otherwise, 


where fo is a positive real number and M is a positive integer number. 
It can be assumed that M > 1 in the rest of the problem. 


(a) Show how the spectrum P (f) of p(t) can be found through the use of 
appropriate theorems and properties of the Fourier transform. Express 
the spectrum as a function of fo and M. Sketch the amplitude den- 
sity spectrum | P(f)|, and denote the placement of maxima and zeros 
(minima) in the spectrum. 

(b) Find the spectrum G(f) of g(t), using P(f) as a starting point and 
applying appropriate theorems and properties of the Fourier trans- 
form. Express the spectrum as a function of a, a, fo, M and to. Show 
that the spectrum has maxima at f = +a fo. Sketch the amplitude 
density spectrum of the received signal for a = 1.1, when the relevant 
parameters are fixed. 

(c) The received signal is processed by the system shown in Fig. P6.2 
below. 


Low-pass 


r(t 
filter gn) 


att) cos(2zfy/) 


— sin(27fo!) 


gñ 


Figure P6.2. Detector scheme. 


First the signal g(t) is multiplied by the complex signal ga(t) = 
e/?7fol = cos(2r fot) — j sin(2z fot). Then the resulting signals are 
passed through ideal low-pass filters. These low-pass filters remove all spec- 
tral components over the frequency fo, and have an amplification of 1 in 
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the pass-band. The result of this processing is the complex signal: 
81) = &r(t) + jgi (t). 


Sketch the amplitude spectrum of the complex signal gi(t) for vo = 
+0.05 x c and for v = —0.05 x c, by fixing the relevant parameters 
(choosing appropriate values). Show that the sign (positive or negative) of 
v can be found from the maximum value in the amplitude spectrum of the 
signal g1 (t). 


DOT: 10.1561/978168083979 1.ch7 


Chapter 7 


Sampling and Digital Signals 


In practical applications of signals and systems, we often need to measure signals 
and analyse them to discover the characteristics of the signals and/or systems present 
in the particular application under consideration. For example, in the receiver of 
a communication system, we would depend a lot on the received signal to under- 
stand the nature of the channel through which the signal propagation takes place. 
Another example would be the non-invasively collected ECG signals from the chest 
sensors/electrodes of a subject/patient to process and diagnose the condition of the 
heart. 

Most of the signals that we encounter in practice are analog in nature, i.e., 
continuous-time and continuous-amplitude signals. On the other hand, we use the 
power of digital computers and digital signal processors to do the analysis and/or 
processing of these signals, which require signals in the digital (i.e., discrete-time 
and discrete-amplitude signals) format. So, it becomes necessary to convert the ana- 
log signals into digital signals and this is done through the processes of sampling 
and quantization. The device which does sampling and quantization is known as 
the analog-to-digital converter (ADC). 

It is very important to ensure that we do not lose any information through the 
process of sampling; otherwise, the inferences that we make about the analog signal 
based on our analysis of the sampled signal will not be useful. Since the process 
of quantization results in loss of accuracy in the signal amplitude, it is extremely 
important to design the quantizer to minimize this error. 
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The following topics are discussed in detail in this chapter. 
e Theoretical concepts behind sampling of signals: 


— Relation between sampling frequency and signal bandwidth. 
— Concept of aliasing. 
— Reconstruction of analog signal from samples. 
— Nyquist’s sampling theorem. 
e Design aspects of quantizer. 
e Definition and properties of Fourier transform (or spectrum) for discrete- 
time signals. 
e Use of z-transform in the study of discrete-time signals. 


7.1 Sampling of Analog Signals 


Let xa(t) represent an analog signal and let Xq(f) be its Fourier transform such 
that 


|Xa(f)| =0 for |f| > B. (7.1) 


That is, xa (t) is a band-limited signal, and the maximum frequency component 
in! xq(t) is at +B Hz. 

Let us sample the continuous-time signal xa(t) at the rate of fs samples per 
second, i.e., with a sampling interval of T; = 1/fs seconds. This is shown in 
Fig. 7.1 below. An example of the signal xa (t) and its sampled versions are shown in 
Fig. 7.2. As can be seen, the sampled signals, x[n] takes values of xa (t) at instances, 
t =nT,, where n = 0, +1, 42,.... 

Recall from Chapter 6 that sampling can be done by multiplying xa(t) with a 
periodic train of impulses spaced at T; seconds. This periodic impulse train and its 


Sampler 
Xq(t) x[n] = xa (nT;) 
Analog Discrete-time 
Signal Signal 
1 
ag 


Figure 7.1. Schematic representation of periodic sampling of an analog signal. 


1. For the signal xa (t) with its Fourier spectrum given by Eq. (7.1), we say that the 2-sided bandwidth is 2B, 
or the one-sided bandwidth is B. 


Sampling of Analog Signals 


Xq(t) 
0 t 
(a) 
x[n] x[n] = xa(nTs) 
a, 3 uae Xa(t) 
HT Oe & S i 
Ty. 2 BT AT SR a t 
(b) 
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Figure 7.2. Example of an analog signal x,(t) and its sampled version, x[n]. (a) Analog 


signal and (b) Sampled (discrete-time) signal. 


Fourier transform are given by, 


i(t) = > ôlt — nT) 


I= fe > df —kfs). 
k=—0o 
We get the sampled signal as, 
xs(t)=xalt) D, G-n) = D, ra(nT)d(t — nTs) 


CO 


= >. x[n]ó(t — nT;) 


n=— 00 


(7.2) 


(7.3) 


(7.4) 
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= +++ 4+x[—2]6(t + 2T,) + x[-1]6(t + Ts) + x[0]6(t) 
+x[1]o(t — Ts) + x[2]6¢ — 2Ts) +, (7.5) 


where we denote the samples of xq(t) by x[n]. That is, 


x[n] A Xqg(nT;) = [xq(t) at t =nT;], (7.6) 


where n is an integer in the range [—0o, +00]. At instants other than the sampling 
instants, i.e., t Æ nT;, note that xs (t) = 0. 

Noting that Fourier transform of the product of two signals (in the time domain) 
is equal to the convolution of the Fourier transforms of the two signals (in the 
Fourier/frequency domain), the Fourier transform of the sampled signal can be 
obtained as 


X(f) = Xa(f) 8 I(F) 


= Xa(f)® Ẹ > oF -er 


k=—0o 


= fs >) Xa) 8U — kf) (7.7) 


k=—0o 


=f > Xalf — kf) 


k=—0o 
= fsb + Xa(f +2 fs) + Xaf + fs) + Xalf) 
+Xalf — Ja) + Aa f = 2h.) to), (7.8) 


Thus, X(f) is obtained by adding periodically the shifted copies of Xq(f). 
Figure 7.3 illustrates this for two choices of the sampling frequencies. Using Fig. 7.3, 
we can deduce several concepts underlying discrete-time signals.’ 

It can be seen from the above figure, that the spectra of the sampled signals 
overlap each other when the sampling frequency (f2) is less than 2B (Fig. 7.3(c). 
On the other hand, if the sampling frequency is greater than 2B, (Fig. 7.3(b)), the 
spectra does not overlap, making it easier to reconstruct the original signal from the 
sampled signal. 


2. Since we have not quantized the values of the samples x[n] into discrete-amplitude, strictly speaking, we 
should call x[n] as a discrete-time signal (or sequence) and not digital signal. 
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X0 
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(c) 


Figure 7.3. Spectra of signals before and after sampling (with different sampling fre- 
quencies): (a) Analog signal xa(t) with 2-sided bandwidth 2B, (b) Sampled signal xı [n] 
with sampling frequency fı > 2B, and (c) Sampled signal x2[n] with sampling frequency 
fo < 2B. 


7.2 Signal Reconstruction from Samples 


To address the problem of reconstruction of a continuous-time signal from its sam- 
ples, we ask the following questions. 


Is it possible to perfectly reconstruct the analog signal x,(t) from its sam- 
ples x[n]? How can this be done? In other words, how can we obtain the 
spectrum Xq(f) of the analog signal from the spectrum X (f) of the sam- 
pled signal? What conditions must be satisfied for perfect reconstruction to 
be possible? Conversely, what are the conditions which make perfect recon- 
struction impossible? 


Using Fig. 7.3, we shall answer these questions. 
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7.21 Perfect Reconstruction 


Consider Fig. 7.3(b). Since the sampling frequency fı is chosen to be greater 
than 2B, observe that the spectrum f| Xq(f) in the frequency range [-B, +B] 
is not affected by the higher frequency spectral images fı X(f + kfi) fork = 
El E2 

Let us pass the samples x[n] through an ideal low-pass filter (LPF) whose fre- 
quency response is given by, 


m for —0.5f1 < f < 0.5fi 
H(f) = (7.9) 
0 otherwise. 
The impulse response of this LPF is given by, 
h(t) = F! [H (f)] = sinc (fit). (7.10) 
Therefore, we get the output of the LPF as, 
Xa(t) = {x[n]} @ h(t) = xst) 8 h(t) 
[0,0] 
= >> x[njsinc(fi¢ —nT,)). (7.11) 
n=—oo 


It is easy to see from Eq. (7.8) and Fig. 7.3(b) that the spectrum of the LPF output 
will be Xa(f). That is, the signal X(t) at the LPF output will be same as the 
original analog signal xa (t). 


§ Perfect reconstruction of the analog signal xa(t) from its samples taken at sampling rate 
fi is possible if the sampling rate is chosen to be greater than or equal to twice the maximum 


frequency B of Xq(t). That is, 
Sampling rate > 2B. (7.12) 


This is known as Nyquist’ sampling theorem. The frequencies 2B and B are known as 
Nyquist rate and Nyquist frequency, respectively, of the signal xa (t). 


$ If fi > 2B, then perfect reconstruction of Xq(t) from its samples x[n], taken at rate fı, 
can be done by passing the samples through an ideal low-pass filter with cut-off frequencies 
+0.5 fı and gain 1/fi. 


7.2.2 Spectral Aliasing 


Consider Fig. 7.3(c). In this case, the sampling rate f2 does not obey Eq. (7.12). 
As a result, the higher frequency spectral images f2Xa(f + f2) and foXa(f — fr) 
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Figure 7.4. Illustration of aliasing. 


Sampler 


P Anti-aliasing | *a(¢) KK X[n] 
a Lowpass Filter 


Figure 7.5. Use of anti-aliasing filter to avoid aliasing. If f2 is the sampling rate, then the 
low-pass filter limits the bandwidth of xa(t) to [—0.5 fo, 0.5 f2], resulting in a(t). 


overlap with the the spectrum f2Xa(f) in the range [-B, +B]. This is called 
spectral aliasing. Because of aliasing, it is easy to see that we cannot recover the 
original spectrum Xq(f) from X(f). 


§ Perfect reconstruction of an analog signal xq(t) from its samples (x[n]) is impossible if 
the sampling rate is less than twice the maximum frequency B of the signal xq(t). That is, 


Sampling rate < 2B. (7.13) 


An example of aliasing is illustrated in Fig. 7.4, where two sinusoids with fre- 
quencies fı = 1/8 Hzand f2 = —7/8 Hz yield identical samples when sampled at 
fs = 1 Hz. This means that, when the signals are reconstructed from the sampled 
signal, it will never be able to obtain the original signal. 


7.2.3 Anti-Aliasing Filtering 


We can avoid aliasing by pre-filtering the signal xa (t) by a low-pass filter to limit the 
bandwidth of the signal to satisfy the condition given by Eq. (7.12). This filtering 
should be done before sampling, as shown in Fig. 7.5. Such a filter is known as 
anti-aliasing filter or bandlimiting filter. In Fig. 7.5, the spectrum of the samples 
x[n] is free from aliasing with respect to the signal x,(t). That is, the signal Xq(t) 
(not xa(t)!) can be perfectly reconstructed from the samples x[n]. 

From power and complexity considerations, it is good to use an anti-aliasing filter 
to band-limit the signal, so that the sampling rate can be reduced, thus reducing the 
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complexity of the whole process. However, this may result in loss of information 
which can never be recovered from the samples. 


7.2.4 Choice of Sampling Frequency 


Selection of the sampling frequency involves several tradeoffs. 


e Sampling rate should be as low as possible to minimize (i) memory required 
to store the data, (ii) bandwidth required to transmit the data, (iii) power 
required to process the data at high-speed, (iv) cost required to design and 
fabricate components/devices to operate at high-speed, etc. 

e Sampling rate should be as high as possible (i) to avoid aliasing, (ii) to relax 
the sharp cut-off characteristics required of filters used for bandlimiting the 
signals, etc. 


7.3 Quantization 


As mentioned earlier, digitization of signals involves sampling and quantization, 
which are performed by a device known as the analog-to-digital converter (ADC). 
In this section, we shall briefly touch upon quantization. 

The process of converting a discrete-time continuous amplitude signal into a 
digital signal by expressing each sample value as a finite number of digits is called 
quantization. The task of the quantizer is to convert the input sample x[n], which 
is continuous-valued, into a discrete-valued format. A simple quantizer, known as 
the uniform quantizer, is described here. 

Let the dynamic range of the input samples x[n] be [—Xmax, Xmax] with 
Xmax > 0, being the maximum value of the signal. The quantizer divides this 
dynamic range into L equal intervals (also known as quantization step-size or reso- 
lution) of length A = Mont, and i" interval is given by, 


[di—z1, di] with di = —Xmax tid, (7.14) 


fori = 1,..., L. This is illustrated in Fig. 7.8(b). The discrete-valued output of 
the quantizer is given by the middle-point of each interval. Therefore, we get the 
quantizer output as 
dj-1 + dj , 
x[n] = = if x[n] € [di-1, di]. (7.15) 
If we have b-bit quantizer, then L = 2°+! and every sample x[n] will be repre- 
sented using a b-bit binary-word. Thus, with a sampling rate of fs, the number of 
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Quantizer 
x[n] Ofx{nl] x[n] 


Figure 7.6. Schematic diagram of quantizer (actual system). 


x[7] 


x[n] = x[n] + e[n] 


Figure 7.7. Mathematical model of quantization noise (mathematical model). 


bits generated per second will be bf;. Clearly, more the number of bits per sample 
used in the quantizer, less will be the error incurred in quantization, and more will 
be the storage space and/or speed required to handle the generated data. 


7.31 Quantization of Continuous-Amplitude Signals 


A digital signal is a sequence of numbers (samples) in which each number is rep- 
resented by a finite number of digits (finite precision). The error introduced in 
representing the continuous-valued signal by a finite set of discrete-value levels is 
called quantization error or quantization noise. Figure 7.6 illustrates the block dia- 
gram of an actual quantizer and its mathematical model is given in Fig. 7.7. 

We denote the quantizer operation on the samples x[n] as Q[x[n]] and the 
sequence of quantized samples as x,[n]. Hence, 


Xg{n] = QO[x[n]]. (7.16) 
The quantization error is a sequence eg[n] defined as 
€g[n] = xg[n] — x[n]. (7.17) 


The quantization process is illustrated with an example below. Let us consider 
the discrete-time signal 


0.9" for n>0 


0 for n <0 (7.18) 


x[n] =| 


obtained by sampling the analog exponential signal x,(t) = 0.9‘, t > 0 witha 
sampling frequency fs = 1Hz (see Fig. 7.8(a)). Observation of Table 7.1, which 
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FA Quantization 
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Quantizer Range 


Figure 7.8. Illustration of quantization. 


shows the values of the first 10 samples of x[n], reveals that the description of the 
sample value x[n] requires n significant digits. 

Let us assume that we want to use only one significant digit. To eliminate the 
excess digits, we can either simply discard the extra digits (truncation) or discard 
them by rounding the resulting number (rounding). The resulting x,[n] corre- 
sponding to the truncation and rounding operations are given in Table 7.1. We dis- 
cuss here the quantization by rounding. 

The rounding process is graphically illustrated in Fig. 7.8(b). The values allowed 
in the digital signal are the quantization levels, whereas the distance A between 
two successive quantization levels is the quantization step-size or resolution. The 
rounding quantizer assigns each sample of x[n] to the nearest quantization level. 
In contrast, a quantizer that performs truncation would have assigned each sample 
of x[n] to the quantization level below it. The quantization error in rounding is 
limited to the range of —A/2 to A/2, that is 


A 
F (7.19) 


A 
a < e,[n] < 


In other words, the instantaneous quantization error cannot exceed half of the 
quantization step-size (see Table 7.1). 
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Table 7.1. Numerical illustration of quantization with one significant digit 
using truncation or rounding. 
x[n] Xg[n] Xg[n] e[n] 


n Discrete-time signal (Truncation) (Rounding) (Rounding) 


0 1 1.0 1.0 0.0 

1 0.9 0.9 0.9 0.0 

2 0.81 0.8 0.8 —0.01 

3 0.729 0.7 0.7 —0.029 

4 0.6561 0.6 0.7 0.0439 

5 0.59049 0.5 0.6 0.00951 

6 0.531441 0.5 0.5 —0.031441 

7 0.4782969 0.4 0.5 0.0217031 

8 0.43046721 0.4 0.4 —0.03046721 
9  0.387420489 0.3 0.4 0.012579511 


If Xmin and Xmax represent the minimum and maximum values of x[n] and L 
is the number of quantization levels, then 
_ Xmax — Xmin R 


A= = a 
L-1 L-1 20) 


The numerator of Eq. (7.20) is defined as the dynamic range (R) of the signal. In our 
example, Xmax = 1.0, Xmin = 0, and L = 11, which makes A = 0.1. Note that 
if the dynamic range is fixed, increasing L results in a decrease of the quantization 
step-size. Thus the quantization error decreases and the accuracy of the quantizer 
increases. If the quantizer has b + 1 bits of accuracy and the quantizer covers the 
entire range R, the quantization step is 


R 


A= abet" (7.21) 


7.3.2 Analysis of Quantization Errors 


To determine the effects of quantization on the performance of an ADC, we adopt 
a statistical approach because the quantization error is assumed to be random in 
nature. We model this error as noise that is added to the original (unquantized) 
signal (see Fig. 7.8(b)). If the input analog signal is within the range of the quantizer, 
the quantization error eg[n] is bounded in magnitude (i.e., |eg[n]| < A/2), and 
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Figure 7.9. Probability density function for the quantization error. 


the resulting error is called the granular noise. When the input falls outside the 
range of the quantizer (clipping), eg [n] becomes unbounded and results in overload 
noise. The following analysis is based on the assumption that there is no overload 
noise. 

To carry out the analysis, we make the following assumptions about the statistical 
properties of eg[n]: 


e The error eg[n] is uniformly distributed over the range -$ < eg[n] < S, 

e The error sequence €q[n] is a stationary white noise process.’ In other words, 
the error ég[n] and error eg[m] for m Æ n are uncorrelated.‘ 

e The error sequence e,[n] is uncorrelated with the signal sequence x[n]. 

© The signal sequence x[n] is zero mean and stationary. 


Under these assumptions, the effect of the additive noise e,[n] on the desired 
signal can be quantified by evaluating the signal-to-quantization-noise (power) ratio 
(SQNR), which can be expressed on a logarithmic scale (in dB) as 


SQNR = 10 logo (=) (7.22) 


n 


where py = o2 = E[x2[n]] is the signal power and pn = a2 z E[e?[n] is the 
power of the quantization noise. Here, E[.] is the expectation operation. 

If the quantization error is uniformly distributed’ in the range (—A/2, A/2) 
as shown in Fig. 7.9, the mean value of the error is zero and the variance 


3. This will be discussed in a later chapter. 
4. This will be discussed in a later chapter. 


5. Details of uniform PDF can be seen in Appendix B. 
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(the quantization noise power) is, 


A/2 A/2 A2 
n= o2 = e *p(e)de = = if e E (7.23) 


—A/2 a 2 


By combining Eq. (7.21) with Eq. (7.23) and substituting the result into 
Eq. (7.22), the expression for SQNR becomes 


SQNR = 10 logy, (= )- = 20 logy, (= ). (7.24) 
P Ce 
= 20 log)y(ox) — 20 logio (ae), 
A 
= 201 ox) — 20lo A) + 10lo 12); 2 Oe = ——, 
O810(0x) 810(A) 81012) J2 
R R 

= 20 log) (ox) — 20 logio N + 10.79; A= J 

= 20 log) (ox) — 20 logio (R) + 6.02b + 16.81, 


R 
= 6.02b + 16.81 — 20 logio (= -) dB. (7.25) 


This equation shows that the SQNR depends on the range R of the ADC and 
the statistics of the input signal. Equation (7.25) shows that each additional bit (b) 
in the quantizer increases the SQNR by © 6dB. 


7.4 Concluding Remarks 


e Theory behind sampling an analog signal is described. 

e Spectral relationships between the analog and sampled signals described in 
detail with illustrations. 

e The function of anti-aliasing filters in sampling is explained. 

e Conditions for perfect reconstruction of signals from sampled signals are 
described. 

e Quantization process and the analysis of errors associated with it has been 
discussed in detail. 
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Exercises 


7.1. In this problem, consider a band-limited continuous-time signal xa (t) and 
its echo xg(t — t), where t is a time-delay, arrive simultaneously at a TV 
receiver. The received analog signal is modelled as, 


ralt) = xal) + axat — 1), lal <1. 
This signal is processed by the system shown in Fig. P7.1 to generate 


the analog signal ya (t) (In the figure, ADC: Analog to Digital Converter, 
DAC: Digital to Analog Converter, and fs: Sampling frequency). 


Y(t) 


Figure P7.1. 


(a) Isit possible to specify fs and H (z) so that ya (t) = xa (t) (i.e., remove 
the “ghost” xa (t — T) of xa (t) from the received signal, ra(t))? If yes, 
discuss the choice of fs and H(z). 


In the following, it is assumed that the signal xa(t) has the spec- 
trum as shown in Fig. P7.2. Here, B is the one-sided bandwidth of 
the signal xq(t). This signal is passed through two systems as shown 
in Fig. P7.3(a) and P7.3(b), respectively (In Fig. P7.3(a) and P7.3(b), 


(.) represents the squaring operation). 


XA f) 


—B 0 B 


Figure P7.2. 


(b) Sketch the spectra of y[n] and s[n] in Fig. P7.3(a) and Fig. P7.3(b), 
respectively if the sampling frequency fs = 2B is chosen. 
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Figure P7.3. 


(c) Determine yı (t) and y2(t) if xg(t) = cos2a fot, fo = 20Hz and 
fs = 50H z. Are there any relationship between yj (ft) and y(t)? 
(Hint: cos? (0) = 5 [1 + cos(20)]) 
7.2. Consider the spectrum (base-band) Xq(f) of an analog signal xa(t) as 
shown in Fig. P7.4. Using a scaled impulse train, Ts X c_o 6(t — nTs), 
the analog signal xa (t) is sampled to produce the discrete-time signal x[n]. 


Here, T; is the periodicity of the impulse train. fe in the figure is the one- 
sided bandwidth of the signal xa (t). 


Xaff) 


>fe 0 fe f 


Figure P7.4. 


(a) For this signal xa(t), what is the minimum sampling time T; that 
results in alias-free spectrum (X (f)) of the sampled signal, x[n]? Plot 
the corresponding spectrum X (f). 


In the following, it is assumed that fe = 10*Hz and the signal 
Xq(t) is modulated using a complex exponential e/%", where Qo = 
m x 10° rad/sec (the arrangement shown in Fig. P7.5) to produce the 


modulated signal y(t). 
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elt Oy =a x 10° 


, AL 
x(t) l y(t) a(t) 


Figure P7.5. 


(b) Sketch the Fourier spectrum Y (f) of the modulated signal y(t). 

(c) The modulated signal y(t) is then sampled and passed through a 
reconstruction filter (with filter impulse response h(t)) that demod- 
ulates y(t) so that xq(t) can be retrieved at the output. What are the 
possible sampling frequencies? Sketch the ideal |H(f)| for a suitable 
reconstruction filter, h(t). |.| here represents the magnitude (abso- 
lute value). 


7.3. Normal and over-sampling ADC (analog to digital converter) with and 
without anti-aliasing filter: The block diagram in Fig. P7.6 shows different 
steps in sampling and reconstructing an analog signal, xq(t). 


x, (1) x[n] x, (t) ¥,(t) 


10 Hz 10 Hz 


x, (1) 
| Oo 


Figure P7.6. 
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The signal xa (t) has a bandwidth |f| < 5 Hz. It is digitized at 10 Hz 
to give x[n]. To re-construct xa(t) (the reconstructed signal is is denoted 
as Xq(t)), x[n] is passed into an ideal DAC (digital to analog converter) 
as shown. The output xs (t) = ... + x(O)d(t) + x(1)ô (t — D) +... 
(continuous-time representation of x[n]) of the ideal DAC gives a pulse 
which approximates an impulse for every x[n]. Various signals (xa(t), 
x[n], and x; (t)) are depicted in Fig. P7.6. Sketch the spectrum after DAC. 
Determine a suitable filter (A(t)) that can recover xa (t) from the DAC out- 
put (i.e., from xs(t)). 

7.4. Ideal and zeroth-order hold DAC: An ideal DAC converts x[n] to an 
impulse train x;(¢). A practical DAC on the other hand converts x[n] into 
a step waveform x p(t) as shown in Fig. P7.7 (i.e., a practical DAC gives 
a pulse of width 1/f; seconds instead of an impulse for every x[n]; fs is 
the sampling frequency). See that xpa (t) = xs(t) ® rect(10r). Relate 
X pa(f) to X(f). How can this zeroth order hold effect be compensated? 


| x[n] | x(t) zry — Pane 
10Hzdata ” ideal = 
y N ee |) rect | =rect(10r) 


= Bi a 
10 Hz a T CEJ 
Practical DAC 
Figure P7.7. 


7.5. The amplitude spectrum of one analog signal is shown in Fig. P7.8. The 
signal is sampled with a sampling interval T; = 140ms (milliseconds). 

Sketch roughly the amplitude spectrum of the sampled signal in the 

frequency range below 10Hz. Comment on the choice of sampling interval. 

7.6. (a) Sketch x[n] =...,0,0, e793, e706, e799 e712... with x[0] = 

e~°3, Write down and sketch the continuous-time representation of 


x[n], assuming that a sampling frequency of 0.2 Hz has been used. 
Determine the z-transform and spectrum of x[n]. 

(b) The signal, x[n], in Question (a) is obtained from sampling an analog 
signal, xq(t), directly. Using the exponential and unit step functions, 
suggest how xa (t) may look like. Give two possible answers. Can x[n] 
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|X (f)| 


0 2 4 6 (Hz) 


Figure P7.8. 


be used to recover xa (t) perfectly? Why? By using a perfect D/A con- 
verter and an anti-aliasing filter, an analog signal, xp(t), is generated 
from x[n]. Write down a formula from which xp (t) may be calculated. 


DOT: 10.1561/9781680839791.ch8 


Chapter 8 


z-Transform of Discrete Time Signals 


Laplace transform is the concept of transforming a function of time into a function 
of frequency. For the analysis of continuous time LTI systems, Laplace transform 
has been used extensively. The variable used in the Laplace transform iss = o + jQ, 
which represents a complex frequency, i.e., it is frequency with a real and imaginary 
part. The general expression for the two-sided Laplace transform of a continuous- 
time signal x(t) is given by, 


X(s)= f x(t)e “dt, (8.1) 


where the integral is taken as a line integral along a suitable closed contour in the 
complex s—plane. To learn more about Laplace transform, one may refer [8]. 

z-transform is the discrete-time version of the Laplace transform. Here, we use 
the variable z = re/?, which is complex (with magnitude |z| = r, and Zz = 8) 
instead of s. By applying the z-transform to a sequence of data points, we create 
an expression that allows us to perform frequency-domain analysis of discrete-time 
signals. 

With the z-transform, we can create transfer functions for digital systems, and 
we can find (and plot) poles and zeros on a complex plane for stability analysis. It 
can be used for finding the output of a system to an input, estimating the input 
signals based on the outputs and the transfer function of the system. The inverse 
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z-transform allows us to convert a z-domain transfer function into a difference equa- 
tion that can be implemented in a computer or in a digital signal processor. 


8.1 z-Transform 


The z-transform of a discrete-time signal x[n] is defined as, 


CO 


X(z) = » x[n]z” (8.2) 


n=—OO 


where z = rel? isa complex variable, r = |z| and 0 = Zz. Then X (z) can be 
expressed as, 


CO 


Xka > sare (8.3) 


n=—OO 


Associated with each X (z) is its region of convergence (ROC) which is the set 
of values of z for which X (z) attains a finite value in the complex z-plane. In the 
ROC of X (z), |X (z)| < co. But 


|X(z)| = » x[n]r7"e7 70" 
= > [tarred = > lal". (8.4) 


The problem of finding the ROC for X (z) is equivalent to determining the range 
of values of r for which the sequence x[n]r 7” is absolutely summable. To elaborate, 
let us express Eq. (8.4) as, 


—1 oo 
=i x[n] 
[X (z)| po |x[n]r i> =h 
=F |xt-nyr"|4+ = (8.5) 
n=1 n=0 


If X(z) converges in some region of the complex plane, both summations in 
Eq. (8.5) must be finite in that region. If the first sum in Eq. (8.5) converges, there 
must exist values of r small enough such that the product sequence x[—n]r”, for 
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Im(<) 


=-plane 


(a) Re(-) 


ow 
ROC for Yea" 
n=1 


\m(=) 


=-plane 


(b) 


(c) 


Figure 8.1. ROC for X(z) and its corresponding causal and anti-causal components. 


1 < n < œ, is absolutely summable. Therefore, the ROC for the first sum consists 
of all points in a circle of radius r1, where rı < 00, as illustrated in Fig. 8.1(a). On 
the other hand, if the second sum in Eq. (8.5) converges, there must exist values 
of r large enough such that the sequence x[n]/r”, for 0 < n < œ, is absolutely 
summable. Hence the ROC for the second sum in Eq. (8.5) consists of all points 
outside a circle of radius r > r2, as illustrated in Fig. 8.1(b). 

Since the convergence of X (z) requires that both sums in Eq. (8.5) be finite, 
it follows that the ROC of X (z) is generally specified as the annular region in the 
z-plane, r2 < r < r1, which is the common region where both sums are finite (see 
Fig. 8.1(c)). On the other hand, if r2 > r1, there is no common ROC for the two 
sums and hence X (z) does not exist. 
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x[n] 


0<a<) 


(a) 


Figure 8.2. (a) The right-sided exponential signal, x[n] = a”u[n], and (b) the ROC of X(z). 


8.2 Discrete-time Signal Types and z-Transforms 


Below, some common discrete-time signal types and their corresponding 
z-transforms are explained. 


8.21 Right-Sided Sequences 


The sequence x[n] is said to be right sided if x[n] = 0 for n less than a finite value. 
For such sequences, the ROC is the exterior of a circle. 


E.g., x[n] = a"u[n] => XQ) = (8.6) 


1— az! 


Here, 0 < a < 1. The ROC (Fig. 8.2(b)) corresponds to laz! | <1 or |z| > lal. 


8.2.2 Left-Sided Sequences 


The sequence x[n] is said to be left sided if x[n] = 0 for n greater than a finite 
value. For such sequences, the ROC is the interior of a circle. 


E.g., x[n)=—a"u[—n-1] = XQ@)=- (8.7) 


1— alz 


Here again, 0 < a < 1 and the ROC corresponds to |a~!z| < 1 or |z| < lal. 
This is shown in Fig. 8.3(b). 


8.2.3 Two-Sided Sequences 


For a two-sided sequence (i.e., x[n] for n = —o, ..., 00), the ROC is a ring 
formed by the intersection of the ROCs corresponding to the right-sided and 
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(a) (b) 


Figure 8.3. (a) The left-sided exponential signal, x[n] = —a"u[—n — 1], and (b) the 
ROC of X(z). 


left-sided parts of the sequence. 


E.g., x[n] = a”u[n] + b"u[—n — 1] 


b-z z z 
= : 8.8 
—az! 1—b71z a. ee oe) 


=> Xe) =] 


In determining the convergence of X (z), we consider two cases: 


e |b| < |a|: In this case, the two ROCs do not overlap, as shown in Fig. 8.4(a). 
Consequently, we can not find values of z for which both power series con- 
verge simultaneously. Clearly, in this case, X (z) does not exist. 

e |b| > |a|: Clearly, in this case there is a ring in the z-plane where both 
power series converge simultaneously, as shown in Fig. 8.4(b). The ROC cor- 
responds to |a| < |z| < |b]. 


8.2.4 Finite Duration Sequences 


For a finite duration sequence (i.e., x[n] for n = n1,...,n2 where —oo < nı < 
nz < œ), the ROC is the entire z-plane, except possibly the points z = 0 and/or 
c= ce, 


§ Are FIR filters stable? Why? 


8.3 Properties of ROC 


There are several important properties for the ROCs, which are listed below: 


e Bounded by circles (dependent only on |z|) 
e Connected and bounded by poles or by o0. (ROC cannot contain a pole.) 
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Im(z) 


z — plane 


Re(z) 


\b| <|e| 
X(z) does not exist 


lal < f 
ROC for XE) 


(b) 


Figure 8.4. The ROC for the z-transform of both-sided exponential signal x[n] = a”u[n] + 
b"u[—n — 1]. 


e If x[n] is absolutely summable, then the ROC contains the unit circle, the 
system has a DTFT and is said to be “stable”. 

e A stable and causal sequence (system) has all its poles inside the unit circle. 

e Right-sided infinite sequence: ROC lies outside the outermost pole. If also 
causal, then the ROC includes |z| = 00. 

e Left-sided infinite sequence: ROC lies inside the innermost pole. If also anti- 
causal, then the ROC includes |z| = 0. 

e Two-sided infinite sequence: ROC lies between the two poles. The ROC does 
not include |z| = 0 or |z| = 00. 

e Finite-length sequence: Always converges. ROC always includes 
0 < |z| < oo. ROC includes 0 if sequence is anti-causal, or includes 00 if 
causal. 


The properties of z-transform and z-transform pairs are provided as tables in 


Appendix B. 
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8.4 Relationship to Fourier Transform 


With z = re/® where r = |z| and œ = tan! [3(z)/R(z)], we get 


CO 


X (") = ea [knr] gedon. (8.9) 


n=—00 


where, S(z) is the imaginary part of z and R(z) is the real part of z. We can infer 
the following from Eq. (8.9): 


e z-Transform of a sequence x[n] is equal to the Fourier transform of the 
sequence x[n]r—". Therefore, z-transform can exist even when Fourier trans- 
form may not exist. 

e Fourier transform of a sequence x[n] is equal to the z-transform evaluated 
on the unit circle in the complex plane (i.e., z = e/® when r = |z| = 1). 


8.41 Common z-Transforms and Properties of z-Transform 


The z-transforms of some of the elementary signals are given in Table 8.1. Table 
8.2 lists some of the properties of z-transforms that will be useful in the study of 
signals. In Table 8.2, X (z), X1(z) and X2(z) are the z-transforms of x[n], xı [n] 
and x2[n], respectively. The contour ‘cl’ indicated in the table is a closed contour 


Table 8.1. Some common z-transform pairs. 


Signal z-Transform ROC 
o[n] 1 all z 
1 
u[n] ra lz] > 1 
a"u[n] rs | |z| > lal 
1- gz 
a”u|—n] zj lz| < laļ 
1 =g Z 
—a”u[—n — 1] — iz| < lal 
1- az J 
1 — z~* cos(œo) 
1 
PEELA AA] 1 — 2z7! cos(wo) + z7? lel > 
. Zz sin(@o) 
1 
sin(@on)u[n] Ioaz cos(o0) ree z| > 
nu[n] lz) > 1 
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Table 8.2. Properties of the z-transform for discrete-time signals. 


Property Time domain z domain 
Linearity a,x1[n] + aox2[n] a, X1(z) + a2X2(z) 
Time shifting x[n — k] z= X (z) 
Time reversal x[—n] x (27!) 
Conjugation x*[n] X* (z*) 
Scaling in time domain a"x[n] X (a~!z) 
dX 
Differentiation in nx[n] =z ©) 
dz 
frequency domain 
Convolution xi[n] 8 x[n] X1(z)X2(z) 
Correlation xiin] 8 x5[—n] X1(z)X5 (1/z*) 
1 
Multiplication x1[n]x2[n] — | X1(v)X2 (z/v) v7 !do 
2r j cl 


(complex convolution) 


in the ROC of X1(v)X2 (z/v). If we choose the contour of integration as the unit 
circle z = e/”, we get (since z* = e-/® = z7!) 


x[n] = x[n] @x;[-—n] => X(z) = X1(zZ)X5 k). (8.10) 
x[n] = x[n] @x*[-n] > X2) =X). (8.11) 


8.5 Inverse z-Transform 


The inverse z-transform is formally defined by (using Cauchys integral theorem 


[12]) 


1 
x[n] = a xO a (8.12) 
2nj Je 


where ‘c’ is a closed counter-clockwise contour in the ROC of X (z). Three popular 
approaches for obtaining the inverse z-transform are: 


e Direct evaluation of Eq. (8.12) by contour integration, 
e Partial fraction expansion and table look-up, 
e Power series expansion method. 
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8.5.1. Inverse z-Transform by Contour Integration 


For rational z-transforms, the contour integral can be evaluated using Cauchys 
residue theorem as 


n—-1 


x[n] = sum of the residues of X (z)z”™ at the poles 


of X(z)z"~! inside the contour c. 


In general, if po is a pole of X(z)z”"—! (inside contour c) repeated m times, then 
the residue of X(z)z"~! at po is given by 


1 qm-! ro] 
Res(z = = 8.13 
(2 = po) au | dent | (8.13) 

where y(z) = (z — po)” X (z)z"™!. 
Example: Consider H(z) = ast with |z| > |a|. Then, 
i z”! z” 
H(z)" = = . (8.14) 
l1—az™! z-a 


We take the contour c as a circle at radius greater than |a|. Forn > 0, the only pole 
inside c is z = a. Therefore y (z) = (z — a) H (z)z”7! = z” and m = 1. Hence, 
we get 


h[n] = Res(z = a) = z"|,_, =a" for n> 0. (8.15) 


Forn < 0, inside c, there is a single pole at z = a and |n|-times repeated pole at 
z = 0. Letn = —1. Then, y (z) = 1 for the pole z = a, and y (z) = + for the 


—a 
pole at z = 0. Therefore, with n = —1 and m = 1, we get 


1 


z—a 


h[—1] = Res(z = a) + Res (z = 0) = : 


+ 


= 0. (8.16) 
z=0 


z=a 


Now, letn = —2. Then, y (z) = 4 for the pole z = a, and y(z) = + for the 
twice-repeated pole at z = 0. Therefore, with n = —2, we get 


h[—2] = Res(z = a) + Res(z = 0) 


1 +2(—>) 
za dz\z-—a 


Similarly, it can be shown that A [n] = 0 foralln < 0. Thus, we get h[n] = a”u[n] 


=0. (8.17) 
z=0 


z2 


as the inverse z-transform of the given H (z). 
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8.5.2 Inverse z-Transform by Partial Fraction Expansion 


In this approach, the given X (z) is expressed as a linear combination of simpler 
terms as below. 


X (z) = a X1(z) +a2X2(z) +--+» +axKXK(z) (8.18) 


where X;(z), i = 1,2,..., K, are simpler z-transform expressions whose inverse 
transforms (i.e., x;[n], i = 1,2,..., K) are easily available or known in the form 
of a table look-up, and aj, i = 1,2,..., K, are scalars. Then, we get, 


x[n] = a,x, [n] + azx2[n] +--- + agxg[n]. (8.19) 
This approach is particularly useful when X (z) is a rational function. Let X (z) be 


a proper rational function’ with z = pı being a simple pole (i.e., non-repeated) and 
z = p2 being a pole repeated m times. That is, 


1 gmt 
X(z) = = ; (8.20) 
(1 — piz!) (1 — pzz™!)”  @- pi) @ — pa)” 
Clearly, * 
Xe) _ ai = 
+ (8.21) 
z Z— pı Lo z- F 
Its residues, a and a,x are found as follows: 
X(z) 
aj = = pi) — ; (8.22) 
Z=P1 
1 ar l X (z) 
ak = oe |) (8.23) 
(m—k)! dz” Z z= 
fork =1,2,...,m 
1. In proper rational functions, the degree of the numerator polynomial is less than that of the denominator. 


If the given rational function is not proper, then it can be written as the sum of a polynomial of finite 
14371+0160 +U pd 4 
1+(5/6)271+(1/6)z7? So e a 


length and a proper rational function. For example, X (z) = 


(1/6)z7! 
1+(5/6)z~!+(1/6)z~? ` 


Inverse z-Transform 151 


Example: Consider X (z) = SSS? with |z| > 1. Then, 


z? z? 
X(z) = = 8.24 
= = is,50S eei ae 
X (z) = Z _ a, 4 a2 
Zz (z-—O0.5)(z-1) z-05 z-l 
X 
a= t0 ze =f 
z l=05 Z7 1lz=0.5 
X (z) Z 
z=1 z — 0.5 z=l 
=z 2z —1 2 
X ,) = — 
=e Ne 5 ea 1-051 | Toe! 
=> x[n] = —(0.5)"u[n] + 2u[n]. (8.25) 


8.5.3 Inverse z-Transform by Power Series Expansion 


Given a z-transform with its corresponding ROC, we expand X (z) into a power 
series of the form 


X(z) = > Cie ”, (8.26) 


n=— 00 


which converges in the given ROC. Then, it follows from the uniqueness of the 
z-transform that x[n] = cn for all n. For rational X (z), this expansion may be 
performed by long division. To simplify this process, we may convert the given 
rational X (z) into simpler functions using the method of partial fractions and then 
apply the long division approach. 


Example: Consider X (z) = sess? with two cases of ROCs given by 
(a) |z| > land (b) |z| < 0.5. 

In Case (a), the ROC is the exterior of the circle |z| = 1. Therefore, the underly- 
ing sequence x[n] must be a right-sided one. Therefore, we should seek for a power 
series expansion in the negative powers of z. By doing the polynomial division of 


the numerator of X (z) by its denominator, we get, 


3 7 15 31 
ALi = =9 =3 —4 
(z) +352 +3 +32 + ig 


ee am = 
> ala] ArT | for n=0,1,2,.., 


ea (8.27) 


for n <0. 
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In Case (b), the ROC is the interior of the circle |z| = 0.5. Therefore, the 
sequence x[n] must be a /efi-sided one. Therefore, we should seek for a power series 
expansion in the positive powers of z. For this, the long division is done as, 


1 
X = 
&) 0.5272 — 1.5z7! + 1 
= 2z? + 627 + 1424 + 302° + 627° +--- (8.28) 
9.6, 14,30, 62, for n = —2, —3, —4, —5,... 
> = fi E 2 


8.6 Concluding Remarks 


e The z-transform, the associated ROCs, and its properties explained in detail. 
e Methods for finding the inverse z-transform discussed. 
e z-transform and its relationship to Fourier transform explained. 


Exercises 


8.1. Spectra of finite length sequences. 


(a) Find the z-transform and the spectrum of the finite length geometric 
sequence: 


x[n] =...,0,a°,a!,...,a’,0,0,... 


(b) Find the z-transform and the spectrum of the finite length sinusoid: 


x[n] = ..., a ae al 0 a | 


(c) Find the z-transform and the spectrum of the finite length reciprocally 
decaying sequence: 


x[n] =...,0, 1, 


(d) Spectrum of conjugated and reversed signal: x[n] has a spectrum of 
X(f)= eV—f . Find the spectra of x*[n] and x[—n]. 

(e) Signal with conjugated spectrum: x[n] has a spectrum of X(f) = 
cos(f ). Find the signal that has a spectrum of X*(f). 


8.2. Inverse z-transform from partial fraction and long division. 


(a) Find the signal x[n] with z-transform X (z) = Cm 
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8.3. 


8.4. 


(b) Use long division to express X (z) = = asa function of z 
g p i 


z—1)? 
find x[n]. 


Consider the system (mixer of two signals) shown in Fig. P8.3 below: 


, and 


The signals xı (t) and x2(t) are given by: 


Sampler 


Wd) =x (i) X x(t) yin] = y(nT:) 


x(t) 


x(t) 


Figure P8.3. Mixer. 


xı (t) = 2 sin(27 fit)u(t) 
xo(t) = 3 sin(2z fot)u(t), 


where u (t) is the unit step function defined by: 


() = 0 when t <0 
we 1 when ¢>0. 


The frequencies fı and f2 are 1kHz and 2kHz, respectively. The sampling 
frequency fs is 8kHz. 


(a) Find the z-transform of y,[n]. 

(b) Sketch the zero-pole diagram of the output of the system. Label the 
zeros and the poles. 

(c) The analog signal y(t) is a linear combination of two oscillations with 
frequencies f3 = f2 — fi and f4 = f2 + fi. A digital filter can 
be designed from the zero-pole diagram by placing zeros and poles at 
appropriate places. Suggest a digital filter that removes the signal oscil- 
lating at the frequency f3 from the discrete-time signal ys[n]. Write 
down the z-transform of the filter H(z). 

(d) Write down the expression for the transfer function H (f) of the filter. 
Provide a labeled sketch of |H(f)|. 

Inverse z-transform from partial fraction and long division. 

(a) Find the signal x[n] with z-transform X (z) = Pa 

(b) Use long division to express X (z) = at as a function of z~!, and 
find x[n]. 


DOT: 10.1561/9781680839791.ch9 


Fourier Spectra of Discrete-Time Signals 


The Discrete Time Fourier Transform (DTFT), a member of the Fourier transform 
family, is often used to analyse samples of analog aperiodic signals. From discrete 
samples, DTFT produces a function of frequency that is a periodic summation 
of the continuous Fourier transform of the original analog signals. As we will see, 
DTFT is a continuous function of frequency, and a discrete version of it is the dis- 
crete Fourier transform (DFT), which will be discussed in detail in a later chapter. 


9.1 Spectra of Discrete-Time Signals 


The spectrum of a discrete-time signal indicates how the signal may be thought of as 
being composed of discrete-time complex exponentials. It describes the frequencies, 
amplitudes, and phases of these exponentials that combine to create the discrete- 
time signal. The individual complex exponential functions that sum up to give the 
signal are called the complex exponential components. 

Observe from Figure 7.3 that the spectrum X (f) of a sampled signal is periodic 
with period equal to the sampling frequency fs. This can also be easily verified using 
Eq. (7.8) by showing that 


X(f +mfs) = X(f) for any integer m. (9.1) 


155 


156 Fourier Spectra of Discrete-Time Signals 


Thus, sampling a signal in time-domain results in periodicity in the frequency- 
domain. Note that this periodicity of the spectrum is irrespective of whether or not 
the original analog signal x(t) is periodic. 


9.1.1 Discrete-Time Fourier Transform (DTFT) 


Noting from Eq. (7.4) that the sampled signal x[n] has a continuous-time repre- 
sentation given by, 


CO 


xs(t)= >) x[n]o(¢— nT), (9.2) 


n=—OO 


where T; = A is the sampling time and fs is the sampling frequency. We can 
S 
determine its Fourier transform as, 


X(f) Ê Fixin] = Fx; (0), 


CO 


in 5 x[n]d(t — z etl ae. 


v = | n=—00 


[0,0] oo 


5 xm f o(t mt je di, 


—00 


n=—00 
CO 


= > x[n]e iT, (9.3) 


n=—00 


since f% ôt — nT; je?" F'dt = e~J?*I"Ts, Equation (9.3) gives the expres- 
sion’ for determining the Fourier transform of any discrete-time signal. This is also 
known as discrete-time Fourier transform (DTFT), as opposed to the continuous- 
time Fourier transform (CTFT) we studied in Chapter 4. In DTFT, note that 
time is discrete and frequency is continuous. The Fourier series we studied in 
Chapter 3 is also known as continuous-time Fourier series (CTFS). For discrete- 
time periodic signals, we can define the so-called discrete-time Fourier series 
(DTFS). 

As in Chapter 4, the plot of |X (f)| vs f gives the magnitude spectrum of x[n], 
and the plot of the phase of X (f) vs f gives the phase spectrum of x[n]. 


1. Using Eq. (9.3), it is also easy to see that X(f + mfs) = X(f) for any integer m, since elm — 1 and 
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9.1.2 Inverse DTFT 


Given the Fourier transform X ( f), we can obtain the time-domain signal x[n] as,” 


fo/2 Pa 
x[n] = T, l X (fje? Edf. (9.4) 
— fs/2 


Equation (9.4) gives the expression for determining the inverse Fourier transform 
in the case of discrete-time signals. Because the spectrum of a discrete-time signal is 
periodic, the evaluation of inverse DTFT involves integration over one period (i.e., 
[—0.5 fs, 0.5 fs]) of the spectrum only. This is unlike in the case of continuous- 
time signals where the evaluation of inverse Fourier transform requires integration 
of the spectrum over the complete frequency range [—00, oo]. 


9.2 Normalized Frequency Representation 


Because the spectrum X(f) is periodic with period fs = 5 , it is enough to 
describe X (f) over one period given by [—0.5 fs, 0.5 fs] (or [0, fs ]). Therefore, 
for the sake of convenience of representation, it is ohonon to normalize the fre- 
quency variable f by the sampling frequency fs (i.e., $) and it is denoted as, f. 
In this normalized notation, one period of the cen ‘spans the frequency range 
[—0.5, +0.5]. Correspondingly, the normalized sampling frequency and normalized 
sampling period are given as 1 Hz and 1 second, respectively. 

In the normalized domain, i.e., with fs = 1 and Ts = 1, we can express the 
forward and inverse Fourier transforms as, 


A= >) aie” (9.5) 
0.5 a "e 7 

xin = | X(Pe fa f. (9.6) 
—0.5 


2. Equation (9.4) for inverse DTFT can be obtained as follows: 


fs/2 fs/2 
i X(f)? "df = I 
—fs/2 fs /2 


= > xin] ie el2aflm—nlh qf = f.x[m] 


2 


5 
x > ne] el2a fms df 


n=— 00 


since the quantity Je efx flm—nlTs df is equal to fs ifm = n, and is equal to 0 ifm Æ n. 
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Note that the X(f) in Eq. (9.5) is periodic with period 1.0, because of the nor- 
malization. To obtain the DTFT expressions with unnormalized frequency (i.e., 
Eqs. (9.3) and (9.4)) from Eqs. (9.5) and (9.6), scale the frequency axis by the 


actual sampling frequency.’ 


9.3 Effect of Sampling Frequencies on the Spectrum 


Consider a continuous-time signal xq(t) that is band-limited to [—50, 50]Hz as 
shown in Fig. 9.1(a). Let xı[n] denote the samples of xa(t) at sampling rate 
200 Hz, i.e., sampling period Tı = z seconds. The spectrum X1 (f) of x[n] is 
shown in Fig. 9.1 (b). Let us also create another sample-sequence x2[n] from xı [7] 
by artificially increasing the spacing between the samples of xı [n] to T2 = 2T; = 
Tw" Then, we obtain 


CO 


MOS J ahe wm (9.7) 


n=—OO 


CO 


>», xa[n]e i?i" 


n=—OO 


X(f) 


CO 


> x1 [n]e 7}? CPT 


n=—OO 


= X1(2f). (9.8) 


Thus, the spectrum X2(f) of x2[n] is a compressed version of the spectrum X1(f) 
of x;[n], as illustrated in Fig. 9.1(c). 


§ Changing the sampling rate of a discrete-time signal results in scaling of the frequency 
axis: increase in sampling frequency results in expanding the frequency axis and decrease in 


sampling frequency results in compressing the frequency axis. 


On the other hand, if we had directly sampled the analog signal xa (t) at a rate of 
100 Hz to produce the sequence x3[n], the resulting spectrum (X3(f)) would be 
as shown in Fig. 9.1(d). It is interesting to compare the spectra shown in Figs. 9.1(c) 


and (d). 


3. That is, replace the normalized frequency variable f in Eqs. (9.5) and (9.6) by fT; where f is the unnor- 


malized frequency. 
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IXa) 


(a) 


—200 —100 -50 0 50 100 200 f 


—200 —100 —25 0 25 100 200 f 


—200 -100 -50 0 50 100 200 f 


Figure 9.1. Illustration of the effect of different sampling frequencies: (a) spectrum of 
the analog signal x,(t), (b) spectrum of x;[n], obtained by sampling xa(t) at 200 Hz, 
(c) spectrum of x2[n], which is obtained from x[n] by taking the sampling frequency as 
100 Hz, and (d) spectrum of x3[n], which is obtained by sampling x(t) at 100 Hz. 


9.4 Frequency-Domain and Time-Domain Signal 
Properties 


So far, we have introduced several methods for the frequency analysis of signals. 
Several methods are necessary to accommodate different types of signals. To sum- 
marize, the following frequency analysis tools have been introduced: 


e The Fourier series for continuous-time periodic signals (FS), 
The Fourier transform for continuous-time aperiodic signals (FT), 
The Fourier series for discrete-time periodic signals (DTFS), and 


The Fourier transform for discrete-time aperiodic signals (DTFT). 


Figure 9.2 summarizes the analysis and synthesis formulae for these types of 
signals. 

As we can see, there are two time-domain characteristics that determine the type 
of signal spectrum we obtain. These are whether the time variable is continuous or 
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Figure 9.2. Summary of the analysis and synthesis formulae for different types of signals. 
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discrete, and whether the signal is periodic or aperiodic. The summary is, 


Continuous-time signals have aperiodic spectra. 
Discrete-time signals have periodic spectra. 
Periodic signals have discrete spectra. 


Aperiodic finite energy signals have continuous spectra. 


9.5 Analysis of Discrete-Time Signals 


In this section, we shall briefly introduce some tools (including DTFT) for the 
analysis of discrete-time signals. 


9.5.1 Common Discrete-Time Signals 


A number of basic signals appear often in the study of discrete-time signals and 
systems. They are listed below. 


© Unit Impulse Signal: It is denoted by ô[n] and defined as 


1 forn=0 


0 for n #0. 0.9) 


o[n] = | 


This is also known as Kronecker delta function. 


4. The delta function (or, impulse function) d(t) we studied in Chapter 4, where t denotes continuous-time, 
is known as the Dirac delta function. 
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© Unit Step Signal: It is denoted by u[n] and defined as 


asf Snae oao 
© Exponential Signal: It is defined as 
x[n] =a” forall n (9.11) 
where a is a scalar. 
© Sinusoidal Signal: It is given by 
x[n] = Acos(2x fn +0) for all n (9.12) 


where A is the amplitude, f e [—0.5, 0.5] is the normalized frequency, and 
0 e [0, 27] is the phase. 

© Periodic Signals: A discrete-time signal x[n] is said to be periodic with period 
N (N isa positive integer) if, 


x[n] = x[n + kN], for any integer k. (9.13) 


9.5.2 Elementary Manipulations 


Let x[n] be a discrete-time signal. The following shifting operations are often 
required while working with signals. 


© Time Delayed Version: The signal y[n] = x[n — 2] is obtained by delaying 
x[n] by 2 samples in time. That is, shift x[n] to the right on the time axis by 


2 samples. 
© Time Advanced Version: The signal y[n] = x[n+2] is obtained by advancing 
x[n] by 2 samples in time. That is, shift x[n] to the left on the time axis by 


2 samples. 
© Time Reversed Version: The signal y[n] = x[—n] is obtained by reflecting 
x[n] on the time axis with respect to the origin n = 0. 


The signal y[n] = x[—n + 2] is obtained by time-reversing x[n] and 
shifting to the right by 2 samples (Note: y[n] = z[n — 2] where z[n] = 
x[—n)]). 

The signal y[n] = x[—n — 2] is obtained by time-reversing x[n] and 
shifting to the left by 2 samples (Note: y[n] = z[n+2] where z[n] = x[—n]). 
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9.5.3 Laplace Transform and z-Transform 


The Laplace transform is the generalization of Fourier transform and for a signal 
x(t), the Laplace transform is given by, 


X(s)= 1. x(t)e "dt (9.14) 


—0O 


where s = o + jQ. The inverse Laplace transform is, 


1 o +00 
x(t) = — | X(s)e"'ds (9.15) 
22 j Jo- 


Now, from Eq. (9.14), we have, 


X(s) = P x(t)e "dt (9.16) 
= lim J x@t) (e=) (9.17) 


where Ts is the sampling time. Equation (9.17), is the z-transform and is given by 


[0,0] 
X(z) = >, x[n]z" (9.18) 
n=—00 
where 
x[n] = x (nT) 0.19) 
z= eh = eOtDR, (9.20) 
= ef Ts x el OTs = rel®, (9.21) 


where r = e° Ts and œ = QT, (or f = fT). Here @ is the angular frequency of 
the discrete-time signal. When T, = 1, then r = e” and œ = Q (or f = fj. 

The relation between s-plane and z-plane is shown in Fig. 9.3. The jQ 
(frequency) axis in the s-plane becomes a unit circle in the z-plane. Unit circle 
becomes the frequency (œ) axis in the z-plane. The entire left half of the s-plane 
is mapped into the unit circle and the right half of the s-plane is mapped into the 
exterior of the unit circle. 
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Imaginary (=) 


k= 
(unit circle) 


Real (=) 


s = plane z-— plane 


Figure 9.3. Relation between s-plane and z-plane. 


9.5.4 z-Transform and DTFT 


Recall from Chapter 4 that certain conditions must be satisfied by a signal if its 
Fourier transform should exist. Similarly, some conditions must be satisfied for the 
existence of DTFT also. On the other hand, the z-transform (ZT) is applicable to a 
much broader category of discrete-time signals and systems compared to DTFT. In 
simple words, the broader scope of applicability of ZT compared to DTFT follows 
from the following fact: 


$ DTFT is based on representation of signals (and systems) using complex sinusoids e/?* fn, 
whereas ZT is based on representation of signals (and systems) using complex exponentials 


z”, where z is a complex scalar. 


Therefore, the ZT of a discrete-time signal x[n] is defined as 


00 oe) 


X@)= X xak” = X [kir] e (9.22) 


n=— 00 n=— 00 


where z = rei?” Pisa complex variable’ with r = |z| and 2% f being the phase 
of z. Setting |z| = r = 1 in Eq. (9.22), we get, 


CO 


X@Oliqerat = >, xine = xf). (9.23) 


n=—OO 


5. Strictly speaking, z should be defined as re/?*/7 where Ty denotes the sampling period. However, we 


assume that we are working with normalized frequency (f) and hence we use z = re/?*/. 
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In the complex z-plane, |z| = 1 corresponds to a circle of radius 1 with centre at 
the origin. Therefore, we can state the following.° 


$ The DTFT X(f) of a discrete-time signal x[n] can be obtained by evaluating its ZT 
X (2) on the unit circle in the z-plane (i.e., by setting z = e?’ f in X (z)). 


9.5.4.1 Region of Convergence (ROC) of ZT 


The ZT X (z) exists when the infinite sum in Eq. (9.22) converges to a finite value. 
For this to happen, we must have 


> [x[n] "| < OO. (9.24) 


n=— 00 


The range of r for which Eq. (9.24) is satisfied is known as the ROC of the ZT 
of x[n]. Therefore, when we give the ZT of a signal, we should also specify its 
corresponding ROC. In view of Eq. (9.23), we can say that the DTFT of x[n] will 
exist only if the ROC of the ZT of x[n] contains the unit circle |z| = 1. 


9.5.4.2 Properties of ZT and DTFT 


We shall now look at some of the properties of ZT and DTFT. Let x[n] and y[n] 
be two discrete-time signals with ZTs X (z) and Y(z), respectively, and DTFTs 
X(f) and Y(f), respectively. 


e Linearity: Let p[n] = ax[n] + fy[n] where a and p are two scalars. Then, 
we can easily show that 


P(z) =aX(z) + BY(z) => P(f) =aX(f) + BY(/f). (9.25) 


Thus, ZT and DTFT are linear transforms. 
e Time Shifting: Let p[n] = x[n — k] where k is an arbitrary integer. Then, 
we get (with m = n — k) 


CO CO 


P(z) = » x[n —k]z "= > x[m]z—™—* 


n=—OO m=—OO 


6. In view of the notation ‘X(z)’ used for representing ZT, a better notation for DTFT would have been 
‘X (e27 fy, However, in this book, we stick to the notation X(f) for DTFT. 
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=z > x[m]z 7" = z7*X (2). 


=> P@=z7 X), P(f) =e" FEX(f). (9.26) 


In view of Eq. (9.26), z7! is known as 1-sample delay operator. As in Chapter 
4, the only effect of shifting a signal in time-domain is a linear phase change 
in the frequency-domain (no change in magnitude spectrum). 

e Time Reversal: Let p[n] = x[—n]. Then, we get (with m = —n) 


P@)= $, xine” = >) xime” 
= 5 x[m] (=) = X(z7!). 
=> P@=X@'), P(f)=XC(f). (9.27) 
e Frequency Shifting: Let pfn] = e?” finn] where fi is a given frequency. 
Then, we get 
P(f=>- [Artn] e-iz fn — S x[nje -An 
=X(f- fi). (9.28) 


e Symmetric Signals: For symmetric signals (even or odd), DTFT has same 
features as the CTFT in Chapter 4. 


e Scaling in Time-Domain: Let p[n] = a"x[n] where a is a scalar. Then, we 


get (with m = —n) 
P(z)= 5 a"x[n]z" = > x[n] (a=) 
= X(a~!z). (9.29) 


Example 1: x[n] = a"u[n] (a is a scalar). This is called a right-sided sequence, 
because, 


a” for n>O 


0 for n <0. (9.30) 


x[n] = | 
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Then, we can obtain its ZT as, 


(ore) oO 6 , 
X@= X, aunk” = iat" => (az~!) 
n=—00 n—0 n=0 
=1+ (az), + (a) + (az) Ieri 
g o i Jaz™| <1. (9.31) 


The ROC of this X (z) is given by |Jaz—!| < 1, i.e., |z| > la|. In other words, 
X (z) given by Eq. (9.31) will be finite only for the region specified by |z| > Jal. 
To obtain the corresponding DTFT, substitute z = e/?”F in X (z), resulting in 


X(f) = == with |a| <1. (9.32) 
1 — aei?a f 
Thus, we see that the DTFT of the signal a”u[n] will exist only if |a| < 1. This 
implies that the DTFT does not exist for the unit step u[n] since this corresponds 
to |a| = 1. However, the ZT exists even if |a| = 1 and is given by eI with the 
ROC |z| > 1. 


Example 2: y[n] = —a"u[—n — 1] (a isa scalar). This is called a strictly left-sided 
sequence, because 


—a" for n< —1 


a= {0 for n >Q. 


Following the similar steps as in Example 1, we can obtain the ZT and DTFT of 
y[n] as 


(9.33) 


IV 


¥()=— 7S with k< al (9.34) 
1 . 
z 1 
Y(f) = ————~ with |fa| > 1. (9.36) 
1 —ae-J27h 


Comparing Eqs. (9.31) and (9.34)— (9.36), we see how important is the specifica- 
tion of ROC when working with ZTs. Two signals may have the same ZTs, but 
could be different in their respective ROCs. Again, we see that the DTFT does not 
exist for u[—n — 1] since this corresponds to |a| = 1. However, the ZT exists with 
|a| = 1 and is given by i with ROC |z| < 1. 
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§ Show that the ZT of p{n| = a"u[—n] (a is a scalar) is given by i with ROC 
|z| < la|. Examine the DTFT in this case. 


9.6 Concluding Remarks 


e A bandlimited continuous-time signal of 2-sided bandwidth 2B can be 
perfectly reconstructed from its samples taken at rate not less than 2B sam- 
ples/second. An ideal low-pass filter of 2-sided bandwidth 2B can be used to 
reconstruct the continuous-time signal from its samples. 

e The sampling process leads to spectral aliasing if the sampling rate is less than 
2B, and it is impossible to reconstruct the original analog signal from these 
samples. Aliasing can be prevented by using an anti-aliasing filter to band- 
limit the signal prior to sampling. 

e Choice of the sampling frequency and quantizer resolution involves several 
trade-offs. 

e Fourier transform of a discrete-time signal (i.e., DTFT) is periodic with 
period equal to the sampling frequency. 

e The DTFT can also be obtained by evaluating the z-transform (ZT) on the 
unit circle. 

e It is convenient to use normalized frequency representation while dealing 
with DTFT and ZT of discrete-time signals. 

e It is very important to specify the ROC while specifying the ZT of signals. 


Exercises 


9.1. Sketch the numerical values of the spectra for the signals (Fig. P9.1) in 
the frequency domain below 5kHz. Depict both the frequencies and the 
relative amplitude of the respective frequency components. 


(a) The signal go(t) in Fig. P9.1 is given by, 
go(t) = acos(2z fot), 


where fo = 200Hz and a = 1 is a real constant. 
(b) The signal gs(t) in Fig. P9.1 is given by, 


gst) = >) golt)d(t — nT), 


n=—OO 


where Ts = 800 us. 
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Figure P9.1. 
(c) The signal gı (t) in Fig. P9.1 is given by, 


Pe ee for nT, <t < (a+ DTI; 


otherwise, 


where Ts = 800 us. 
(d) The signal g2 (t) in Fig. P9.1 is given by, 


— fgo(t) for nT, <t < (n+ Ts 
p= i otherwise, 


where Ts = 800 us. 
9.2. Spectra of finite length sequences. 


(a) Find the z-transform and the spectrum of the finite length geometric 
sequence: 


0 1 7 
x[n]=...,0,a°,a,...,a',0,0,... 


(b) Find the z-transform and the spectrum of the finite length sinusoid: 


x[n] =..., 0, c0/240.2, e1j270.2 _ 910j2202 g g 
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(c) Find the z-transform and the spectrum of the finite length reciprocally 
decaying sequence: 


x[n] =...,0,1, 


(d) Spectrum of conjugated and reversed signal: x[n] has a spectrum of 
X(f) = = e-f, Find the spectra of x*[n] and x[—n]. : 
(e) Signal with conjugated spectrum: x[n] has a spectrum of X(f) = 
cos( f). Find the signal that has a spectrum of X* (f). 
9.3. Sampling of rectangular, unit step and exponential waveforms: 


(a) The signal x, (t) (shown in Fig. P9.3(a)) is sampled at a rate of 5 sam- 
ples per second (i.e., fs = 5Hz). Write down and sketch the con- 
tinuous and discrete-time representation of the sampled signal. Write 
down their spectra. 


x,(0) 


3 


Figure P9.3. 


(b) A sampling rate of 0.2Hz is used to sample the unit step signal u(t) 
shown in Fig. P9.3(b). Write down and sketch the continuous and 
discrete-time representations of the sampled signal. Write down their 
spectra. 

An analog signal xg(t) = eT” ualt) (where ug(t) is the unit step 
function) is sampled at a rate of fs Hz to generate the corresponding 
discrete-time signal, x[n]. Estimate the spectra of both xa (t) and x[n]. 
Are these different? Why? What should fs be for these to have roughly 
the same shape? 


(c 


wa 
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9.4. Figure P9.4 shows the spectrum Xq(f) of an analog signal x(t). As you 


can see, all the frequency components lie in the low frequency region 


(i.e., low pass spectrum). Sketch the digital spectrum if the signal xa(t) 
is sampled at 50 Hz. 


Xalf) 


Figure P9.4. 


9.5. The spectrum (Xq(f) ) given in Fig. P9.5 is that of a real and band pass 


signal xq(t). It has a bandwidth of 40 Hz, but its highest frequency com- 


ponent is 120 Hz. The signal is sampled at 100 Hz. Sketch the digital 
spectrum and comment. 


Xa(/) 


| 0 


100 i 
40 f 


Figure P9.5. 


9.6. An analog signal xa (t) is corrupted by an additive noise vg (t). Their power 


spectra (Syx(f) and Foo (f), respectively) are given in Fig. P9.6. Design an 
optimum digitization system (sampling system) for the signal which gives 
the best SNR (signal to noise ratio). 


—250 —100 0 100 250 I 


Figure P9.6. 
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9.7. 


9.8. 


The signal xa (t) has a spectrum (Xq(f)) as shown in Fig. P9.7. Only the 
part within |f| < 20 is important. Design a digitization system to sample 
Xq(t) without using any anti-aliasing LPF (low pass filter) and also with no 
aliasing effects. Comment on the advantages and disadvantages. 


-30 0 20 30 f 


Figure P9.7. 


(a) Design a digitization system to sample xa (t) in Fig. P9.7 at the lowest 
possible sampling rate. 

(b) If we sample xa(t) in Fig. P9.7 directly at 50 Hz, will the important 
part of xa (t) be preserved? 


Consider the analog signal: 
Xa(t) T te u(t), 


where u(t) is the unit step function, also known as the Heaviside function 


defined as: 


g= 0 for t<0 
AEE 1 for t>0. 


The spectrum of the analog signal is given as: 


1 


te u(t) eS Orar 


The function and its spectrum are shown in Fig. P9.8. 


(a) Determine the spectrum of the sampled signal x[n] = xa(nTs), where 
T; is the sampling period. 

(b) Plot the signals x[n] = xq(nTs) for Ts = 1/3 sec and T; = 1 sec, and 
their spectra. 

(c) Plot the continuous-time signal £4(t) after reconstruction with ideal 
band-limited interpolation. 
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Figure P9.8. Plot of xa(t) (top) and |X,(f)| (bottom) 


9.9. The real signal gm(t) has a real spectrum Gm(f), which is shown in 
Fig. P9.9, where the median frequency fp is a constant and the bandwidth 


— fo 
B=. 
Gf) 
l 
0.5 
0 0.5 fy fo L5 f 
Figure P9.9. 


(a) Sketch g(t) roughly (groft). 


(b) The 


signal gm (t) is converted to a digital signal gm[n] through a sam- 


pling operation. The sampling interval is T; = A Does the chosen 


sampling frequency obey the sampling theorem? If not, suggest a sam- 


pling interval/frequency, that fulfils the sampling criterion. Sketch the 


spectrum of gm[n] in the frequency range below 2 fo, when T; = nn 


DOT: 10.1561/9781680839791.ch10 


Chapter 10 


Digital Systems 


The contents of this chapter can be considered as the digital (strictly speaking, 
discrete-time) counter-part of the analog systems we studied in Chapter 6. So, we 
will find that the fundamentals behind the topics discussed in this chapter are same 
or significantly similar to that in Chapter 6. 

Since the scope of our study is limited to systems whose inputs and outputs are 
signals, we may define system as a device that is designed to process its input signals 


in a specified manner and generate output signals that meet well defined objectives. 
Therefore, we may consider these systems as generalization of filters. For example, 
we may design filters (or, systems) 


e to extract information about specific quantities of interest from noisy data 
(e.g., enhancing a desired signal buried in noise, recovering the transmitted 
data bits from received noisy signal etc.), 

e toaid in tracking dynamic physical processes (e.g., missile guidance, jamming 
the radar of an enemy vehicle etc.), 

e toaid in medical diagnosis by analyzing the measured biomedical signals (e.g., 
ECG, EEG, etc.), and 

© to find efficient representation of signals (e.g., compression of speech and 
image data, etc.). 
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Figure 10.1. Block diagram of a practical signal processing system. 


To introduce the relevance of the topics discussed in this chapter, we start 
with Fig. 10.1 which shows the block diagram of a practical signal processing 
system, highlighting the main sub-systems. The objective of any system is to pro- 


cess measured signals for the purpose of either extracting some important infor- 


mation or to transform the signal to another suitable form. Due to the many 


advantages of doing this processing in digital domain, it is now very common to 


use a digital signal processor (DSP) as the main processing unit in practical sys- 


tems, as illustrated in Fig. 10.1. Let us take the processing of speech signals as an 


example. 


e Input Transducer: In the case of speech signal, the input transducer is a micro- 


phone that converts the acoustic (sound) waves into an electrical signal, x(t). 
Signal Conditioner: This is an analog circuit that prepares the signal for 
subsequent processing. The signal conditioning tasks involve band-limiting 


the measured signal to reject the noise outside the signal bandwidth 
(e.g., [—5, +5] kHz) of interest, amplify the signal to match the dynamic 
range required by the circuits that follow this unit etc. The band-limiting 
operation also serves to prepare the signal for sampling without aliasing. This 
is what we have discussed earlier as the anti-aliasing filtering operation/pro- 


cess. 


e Analog-to-Digital Converter (ADC): As discussed in Chapter 7, the ADC 


performs the tasks of sampling the analog signal x(t) and digitizing the 
resulting samples using a quantizer. The ADC output samples, x[n], are in 
the form of binary data-words (e.g., 5 or 6 bits per sample). 

Digital Signal Processor (DSP): This is the heart of the system, and its pur- 
pose is to process the digitized signal, x[n], from the ADC. The DSP may be 
designed, for example, to identify what word/sentence was spoken, to iden- 
tify who is the speaker, to find a compressed representation for the recorded 
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signal, to convert the signal into a form suitable for transmission, to extract 
some parameters from the signal, to improve the signal-to-noise ratio of the 
signal, to detect and suppress certain interferences, etc. 


— The DSP may be in the form of a software programme or hardware digital 
circuit. 

— The DSP unit may reside inside a digital computer or it may be a stand- 
alone unit. Binary (i.e., {0,1}) representation is used for the data (or signal 
samples) within the DSP. 

— While the DSP unit is designed to perform a specified task, the main 
constraints that must be taken into account during its design are hard- 
ware complexity, computational complexity, required speed of operation, 
required accuracy in the results, etc. 

— The main components of the digital circuits (or software programme) 
within the DSP are adders, multipliers, and delay elements. Using these three 
basic building blocks, all types of operations can be implemented. 


e Digital-to-Analog Converter (DAC): This is the unit that converts the pro- 
cessed signal, y[n], from the digital domain to the analog domain. It first 


converts the samples y[n], which are in the form of binary data-words, into 
real numbers that represent voltage levels. The resulting sequence of samples 
is passed through a reconstruction filter (e.g., low-pass filter) to generate an 
analog speech signal yq(t). The function of DAC is thus the reverse of the 
function of ADC. 


e Output Transducer: The output transducer, for example, a loud-speaker, con- 


verts the signal y(t) into a sound wave that we can listen. 


Our focus in this chapter is the study of the various fundamental aspects under- 
lying the DSP unit in Fig. 10.1. We use ‘digital system’ to refer to any sub-system 
(or, operation) that is part of the DSP unit. By studying this chapter, we should be 
able to receive clarity and understanding on the following. 


e Classification of digital systems: 


— linear or non-linear, 

— time-invariant or time-variant, 
— causal or non-causal, 

— stable or unstable 


e Characterizing digital systems in time-domain and frequency-domain. 

e Determining the output of a system for a given input, or determining the 
input of a system for a given output. 

e Use of z-transform (ZT) in the study of digital signals and systems. 
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10.1 Input-Output Description of Systems 


Consider, Fig. 10.2 which shows a digital system with input signal’ x[n] and output 
signal y[n]. For the sake of convenience, we use the representation “D[x[n]]’ to 
denote the ‘output of the digital system when the input is x[n]. Therefore, we can 
write 


yin] Ê Dixtn]]. 


For example, consider the input-output relationship for an accumulator? as 
shown below: 


n n—l 

ylal= $ xikl= >So xik] + xin] (10.1) 
k=—0o k=—0o 

= y[n — 1] + x[n]. (10.2) 


We see that from Eq. (10.1), the output at time n = no depends not only on the 
input at time n = no, but also on x[n] at times n = no — 1, no — 2, and so on. 
From Eq. (10.2), we find that the system computes the current value of the output 
by adding (accumulating) the current value of the input to the past value of the 
output. 

Let us have a close look at this simple system. Suppose that we are given the input 
signal x[n] forn > no, and we wish to determine the output y[n] for n > no. For 
n=no,no+1,..., Eq. (10.2) gives, 


y[no] = y[no — 1] + x[nol, (10.3) 
yino + 1] = y[no] + x[no + 1], (10.4) 


f Digital 7 


Figure 10.2. A digital system with input signal x[n] and output signal y[n]. 


1. We assume the normalized frequency representation throughout this chapter. So, the actual sampling fre- 
quency and sampling period are suppressed in the representations that we use here. 


2. An accumulator basically computes the running sum of all the past input values up to the present time, 


yin] = Xz- XA] = x[n] + x[n- 1] +.... 
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and so on. Note that we have a problem in computing y[no], as it depends on 
y[no — 1]. However, 


no—1 


ylno — 1] = > x[k]. (10.5) 


k=—0oo 


That is, y[no — 1] “summarizes” the effect on the system from all the inputs which 
had been applied to the system before time no. Thus the response of the system for 
n > no to the input x[n] that is applied at time no is the combined result of this 
input and all inputs that had been applied previously to the system. Consequently, 
y[n], n > no is not uniquely determined by the input x[n] forn > no. 

The additional information required to determine y[n] for n > no is the initial 
condition y[no — 1]. This value summarizes the effect of all previous inputs to 
the system. Thus, this initial condition together with the input sequence x[n] for 
n > no uniquely determine the output sequence y[n] forn > no. If the initial 
condition is zero, we say that the system is initially relaxed. 


10.2 Block Diagram Representation of Discrete-Time 
Systems 


To build the block-diagram representation of discrete-time systems, we need to 


define the following basic building blocks: 


© An Adder: Figure 10.3 illustrates a system (adder) that performs the addition 
of two signal sequences to form (the sum) another sequence. Here, the inputs 
to the adder is x[n] and x2[n] and its output is y[n] = x[n] + x2[n]. 
Note that it is not necessary to store the sequences in order to perform the 
operation. In other words, the addition operation is memoryless. 

© A Constant Multiplier: This operation is depicted in Fig. 10.4, and simply 


represents applying a scale factor on the input x[n]. The output of this system 
is, y[n] = ax[n], where a is a scalar. This operation is also memoryless. 


x, [7] yin] = xlr] +x] 


x[n] 


Figure 10.3. Graphical representation of an adder. 
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x[n] ————— yin] = axfn] 


Figure 10.4. Graphical representation of a scalar multiplier. 


x[n] yin) = xin] x x[n] 


x[n] 


Figure 10.5. Graphical representation of a signal multiplier. 


x[v7] ra x[n— 1] 


Figure 10.6. Graphical representation of the unit delay element. 


x(n] | we + 1] 


Figure 10.7. Graphical representation of the unit advance element. 


e A Signal Multiplier: Figure 10.5 illustrates the multiplication of two signal 
sequences (x1 [n] and x2[7]) to form another sequence, y[n] = x1[n]xx2[n]. 
This again is a memoryless operation. 

© A Unit Delay Element: It is a special system that simply delays the input by 
one sample. Figure 10.6 illustrates such a system. We can see that the output 
of the system is stored in memory at time n — 1 and is recalled from memory 
at time n to form y[n] = x[n — 1]. This requires a memory and the use of 
the symbol’ z~! denote the unit delay. 

© A Unit Advance Element: This unit advances the input x[n] ahead by one 
sample (Fig. 10.7). It may be noted that such a system is physically impossible 
in real-time, since it involves looking into the future of the signal. 


10.3 Classification of Digital Systems 


There are several ways to classify digital systems, as we did for analog systems. 
We briefly describe below the different classes. 


3. The use of this symbol z7! is apparent from the discussion on z-transform. 


Classification of Digital Systems 179 


10.3.1 Static and Dynamic Systems 


A system D[-] is said to be static or memoryless if its output at any instant n depends 
at most on the input sample at the same time, but not on past or future samples of 
the input. That is, 


yin] = D[x[n]]. (10.6) 

Some examples are, 
yiln] = ax[n], (10.7) 
yaln] = nx[n] + bx’ [n]. (10.8) 


A system is said to be dynamic if it has memory. If the output of a system at time 
n is completely determined by the input samples in the interval from n — N to 
n (N > 0), the system is said to have a memory of length N (finite memory). If 
N = 0, the system is static. If N = 00, the system is said to have infinite memory. 
Some examples are shown below: 


yilan] = x[n] + 3x[n — 1], (10.9) 
N 

yon] = $ x[n — k], (10.10) 
k=0 

yaln] = Do x[n — kl. (10.11) 
k=0 


Here yı[n] is a dynamic system with finite memory of N = 1, y2[n] is again a 
finite memory (N) dynamic system, and y3[7] is a dynamic system with infinite 


memory. 


10.3.2 Linear Systems 


A system D[-] is said to be /inear if it satisfies the principle of superposition. That 
is, the system response to a linear combination of inputs should be equal to the 
linear combination of the system response to each of the input. Let yı [n] and y2[n] 
be the outputs of the system corresponding to the input signals xı [n] and x2[n], 
respectively. That is, yi[n] = D[x,[n]] and y2[n] = D[x2[n]]. Then, the system 
is linear if, 


D [ax,[n] + Px2[n]] = aD[x1[n]] + BDL x2[n]], 
= ayi[n] + y2ln], (10.12) 


for any arbitrary input signals xı [n] and x2[n], and any arbitrary scalars a and 2. 
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10.3.5 Time-Invariant Systems 


A system D[-] is said to be time-invariant if its input-output characteristics do not 
change with time. That is, 


D[x(n]] = yla] => = D[x[n—k]] = y[n—k] (10.13) 


for any input signal x[n] and any time-shift k. Time-invariant digital systems are 
also known as shift-invariant systems. 


10.3.4 Causal Systems 


A system D[-] is said to be causal if its output (y[n]) at any given time depends 
only on the inputs at that time and past (i.e., x[n], x[n — 1], x[n — 2], ---). Ifa 
system does not satisfy this condition, it is called non-causal. 


10.3.5 Stable Systems 


A system D[-] is said to be stable in the sense of bounded-input bounded-output 
(BIBO), if its output is bounded in magnitude when it is excited by an input that 
is bounded in magnitude. 

The condition that the input sequence x[n] and the output sequence y[n] are 
bounded is translated mathematically to mean that there exist some finite numbers 
Mx and My, such that 


|x[n]| < My < œ, ly[n]| < My < co (10.14) 


for all n. If for some bounded input sequence x[n], the output is unbounded 
(infinite), the system is classified as unstable. 


10.3.6 Physically Realizable Systems 


There are two properties of systems that are closely related to the physical realiz- 
ability of systems. They are the causality and stability. Stable and causal systems are 
all physically realizable. 


10.3.7 Linear Time-Invariant (LTI) Systems 


The class of LTI systems is very important in many applications. A system D[-] is 
said to be /inear time-invariant (LTT) if it is linear and time-invariant. That is, for 
the signals we considered above, we should have 


D [ax,[n —1] + x[n — k]] = ayı[n —1] + By2[n — k] (10.15) 


Outputs of LTI Systems (Convolution) 181 


for any arbitrary input signals x[n] and x2[n], any arbitrary scalars a and f, and 
any arbitrary integers l and k. 


10.4 Outputs of LTI Systems (Convolution) 


We shall now derive an expression for the output of LTI systems. Let us assume 
that the system D[-] given in Fig. 10.2 is a LTI system. Further, let A[n] denote 
the impulse response of this system, which is obtained by setting the input, x[n], 
to a unit impulse at n = 0, i.e., d[n]. That is,“ 


hin] = ylallxqjsommy = Ploln]. (10.16) 


Let us consider an arbitrary input signal, as shown in Fig. 10.8. Observe from 
the figure that the sample x[k] at instantn = k can be expressed in the form of a scaled 
version of a shifted unit impulse as x[k]d[n — k] since 


x[k]d[n — k] = o : " P ‘ (10.17) 
Therefore, we can express any sample of the signal as® 
x[n] = +--+ + x[—1]dln + 1] + x[0]o[n] 
talii- 1] + x[2]o[n — 2] + --- (10.18) 


x[-1] x[2] 


Figure 10.8. Any signal x[n] can be considered as the sum of scaled unit impulses sitting 
at each value of n. For example, the sample x[2] at n = 2 can be expressed as a signal 
x2[n] = x[2]ð[n — 2], which is zero for all n 4 2. Similarly, the sample x[—3] at n = —3 can be 
expressed as a signal x_3[n] = x[—3]d(n + 3), which is zero for all n # —3. 


4. The definition of impulse response given by Eq. (10.16) is applicable for any general system. This definition 
is not restricted to LTI systems. 


5. Verify the validity of Eq. (10.18) by evaluating the left and right sides for any value of n. For example, if we 
put n = 1, then only the term x[1]d[n — 1] will remain on the right-side. 
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Observe that Eq. (10.18) expresses x[n] as the sum of scaled and shifted unit 
impulses, the scale factors being the sample values x [k] for each k. Since the system 
is LTI, we can obtain its output for the input x[k]d[n — k] as 


D[x[k]o[n — k]] = x[k]D[d[n — k]] 
= x[k]h[n — k]. (10.19) 


Therefore, we can obtain the output for the input, x[n], as 


yia] = Di[x[n]] = D [E -+ x[—Lo[n + 1] + x[0]o[n] 
+x[1]é[n — 1] + x[2]o[n — 2] +---] 
=---+D[x[—1]o[n + 1]] + P [x[0]o[n]] 
+P [x[1]ðfn = 1]] + P [x[2]ð[n = 2]] ++ 


=- +x[-1]h[n + 1] + x[0]A[n] 
+x[1]A[n — 1] + x[2]h[n —2]+--- (10.20) 


which can be expressed in compact form as 


o0 


yin] = X ximhin — m] Ê x[n] 8 hin]. (10.21) 


m=— 00 


Eq. (10.21) is known as the discrete-time convolution of sequences {x[n]} and {h[n]}. 
It can also be expressed as 


CO 


yin} = $ himin — m] È hfn] @ x[n]. (10.22) 


m=—OO 


§ The output of a LTI system is given by the convolution of its impulse response, hin], with 
the input, x[n]. 


Note from Eq. (10.22) that y[n] will depend upon the future sample x[n + 1] 
if h[—1] # 0. Generalizing this, we can say that a LTI system is causal if and only if 
its impulse response, h(n], is zero forn < 0. All physical systems are causal systems 
since they are unable to look into the future. 


Interconnection of Digital Systems 183 


It can be shown that a LTI system will be BIBO (Bounded Input Bounded 
Output) stable if its impulse response satisfies the absolutely summable condition® 


5 \h[n]| < 00. (10.23) 
Note that 
IHI =| X hine] < S Ihin. (10.24) 


In view of Eqs. (10.23) and (10.24), we can say the following; 

A LTI system is BIBO stable if and only if the Fourier transform (DTFT), H ( f ), 
of its impulse response exists (i.e., |H(f)| < 00) for all f. That is, the region of 
convergence (ROC) of the z—transform, H (z), of h[n] must include the unit circle. 

For physical realizability, a LTI system must be both causal and stable. That is, its 
impulse response must satisfy 


h[n] =0 for n <0 (10.25) 


and 


>, |h[n]| < o. (10.26) 
n=0 


10.5 Interconnection of Digital Systems 


Digital systems can be interconnected to build larger systems. There are basically 
two ways by which they can be interconnected: in cascade (series) or in parallel. 
In a cascade interconnection (Fig. 10.9), the output of the first system is 


yıla] = Pılx[n]], (10.27) 


6. Let x[n] be a bounded input, with |x[n]| < 2 < oo. Then, we get 


co 


> him]x[n — m] 


m=—00 


ly[a]| = < ba |h[m]x[n — m]| 


m=—00 


= > |hA[m]| - |x[n — m]| < B > |h[m]]. 


m=—0o m=—00 


Therefore, for y[n] to remain bounded, i.e., |y[n]| < 00, we should have Eq. (10.23) satisfied. 
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= = = 


Figure 10.9. Cascading of two discrete-time linear systems. 


and the output of the second system is, 


yla] = Palyitnll, 
= D2{D\[x[n]]}. (10.28) 


We observe that the two systems Dı and D2 can be combined or consolidated to a 
single system with overall system function 


De = DP>2. (10.29) 
Consequently, the output of the combined system can be expressed as 
yin] = Pelx[n]]. (10.30) 


In general, the order in which the operations Dı and D2 are performed is 
important. That is, 


Di Ds # DD] (10.31) 


for arbitrary systems. However, if the systems are LTI, then De is time invariant 
and DıD2 = D2D\. That is the order in which the systems process the signal is 
not important. 

In the parallel interconnection (Fig. 10.10), the output of the system Dy is yı [n] 
and that of the system D2 is y2[n]. Hence the total output of the (parallel) inter- 
connected system is, 


yla] = yıla] + yaln], 
= D,[x[n]] + Dolxin]], 
= (Dı + D2)[xIn]], 
=D, [x(n], (10.32) 
where D, = Di + Do. 
Just like we construct larger systems by interconnecting smaller ones, a larger 


system can be decomposed into smaller subsystems for the purpose of analysis and 
easy implementation (we shall see this later). 
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yn] 


yn] 


Figure 10.10. Parallel interconnection of two discrete-time linear systems. 


10.6 Properties of Convolution and Interconnection 
of LTI Systems 


Here, we investigate some important properties of convolution and interpret them 
in terms of interconnecting LTI systems. We have, 


00 


yin] =x[n] 8 hin] = $, xiklh[n — k] (10.33) 


k=—00 


where ® represents the convolution operation. In Eq. (10.33), the impulse response 
h[n] is folded and shifted. The input to the system is x[n]. We also know that, 


CO 


yin] = hin] ® xin] = >) hlklxtn — k]. (10.34) 


k=—0co 


Here, it is the input signal which is folded and shifted. The property embodies in 
Eg. (10.33) and Eq. (10.34) is called the commutative law. That is 


xin] S hin] = h[n] ® x[n]. (10.35) 


Alternatively, we may interpret this form of the convolution formula as a result of 
interchanging the roles of x[n] and A[n]. In other words, we may regard x[n] as 
the impulse response of the system and hA[n] as the input signal. 


10.6.1 Identity and Shifting Properties 


We also note that the unit sample response d[n] is the identity element for convo- 
lution, that is 


yin] = x[n] ® o[n] = x[n]. (10.36) 
If we shift ô[n] by k, the convolution sequence is also shifted by k, that is 


x[n] Q ô[n —k] = y[n — k] = x[n — k]. (10.37) 
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10.6.2 Associative Law 


This law states that, 
[x[n] 8 hy[n]] 8 ho[n] = x[n] 8 [Ay [n] 8 hln]. (10.38) 


From a physical point of view, we can interpret x[n] as the input to a LTI system 
with impulse response h1 [n]. The output of the system, yı [n], becomes the input 
to a second LTI system with impulse response h2[n]. Then the output is, 


yin] = yiln] 8 hain], 
= [x[n] 8 hiin]] 8 h2[7], (10.39) 


which is precisely the left-hand side (LHS) of Eq. (10.38). Thus the LHS of 
Eq. (10.38) corresponds to having two LTI systems in cascade. Now, the right-hand 
side (RHS) of Eq. (10.38) indicates that the input x[n] is applied to an equivalent 
system having an impulse response, say h[n], which is equal to the convolution of 


hy[n] and h2[n]. That is 
h[{n] = hy[n] 8 h2[n], (10.40) 
and 
yin] = x[n] 8 hfn]. (10.41) 


Furthermore, since the convolution operation satisfies the commutative prop- 
erty, one can interchange the order of the two systems with responses hı[n] and 
h2[n] without altering the overall input-output relationship. Associative law can 
be extended for more than two systems easily. Thus, if we have L, LTI systems with 
impulse responses h,[n], ho[n],..., hyn] in cascade, there is an equivalent LTI 
system having an impulse response, h[n] = hi[n] Q h2[n] ®... Q hy [n]. 

Conversely, any LTI system can be decomposed into a cascade interconnection 
of subsystems. 


10.6.3 Distributive Law 
According to this law, we have, 
x[n] 8 [Ayn] + h[n]] = x[n] 8 hy[n] + x[n] 8 ho[n]. (10.42) 


Interpreted physically, this law implies that if we have two LTI systems with 
impulse responses hj[n] and h2[n] which are excited by the same input signal x [n] 
(or in a sense these two systems are connected in parallel), the sum of the two 
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responses is identical to the response of the overall system with impulse response 
hin] = hifin] + hln]. (10.43) 


Thus the overall system is viewed as a parallel combination of the two individual 
LTI systems. This can be generalized to the parallel combination of L, LTI systems. 
The overall system will have an impulse response, 


L 
hini = > hiini: (10.44) 
j=l 


Conversely, any LTI system can be decomposed into parallel interconnection of 
subsystems. 


10.7 Characterizing Digital Systems 


There are several ways to characterize (i.e., describe or represent) digital systems. 
Our discussion in this section is limited to only LTI systems. 


10.71 Difference Equations and Block Diagram 


We can describe a system by specifying how its output, y[m], is related to its input, 
x[n], which, in general, has the form, 


yin] = D [yin — 1],...,yam—N), x[n], ..., x[n — M]] (10.45) 


where D[.] denotes some function of the quantities in brackets. Specifically, for a 
LTI system, the general form of the input-output relationship is, 


N M 
yin] = — $ ayin — k] + D> bexln — k] (10.46) 
k=1 k=0 


where {ax} and {bx} are constant parameters that specifies the system and are inde- 
pendent of x[n] and y[n]. The relationship in Eq. (10.46) is called a difference 
equation and is one of the ways to characterize the behaviour of a discrete-time LTI 
system. 

For example, we have a system described by the following equations: 


y[n] = 5v[n] + 60[n — 1] + mw[n — 2] (10.47a) 
v[n] = x[n] — 3v[n — 1] — 40[n — 2]. (10.47b) 
Eqs. (10.47a) and (10.47b) are known as the difference equations that represent the 


underlying system. If we are given the input samples x[n], it is very straightforward 
to compute the samples of the output, y[n], using the above equations. 
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Observe that the implementation of Eq. (10.47) consists of the three basic 
units: adders, multipliers, and delays. Recall that z~! represents the 1-sample delay 
operator. 

The complexity of a digital system refers to the number of multiplications and 
additions it must perform during each sample interval. Since the input samples, 
x[n], are coming at some rate (e.g., 1000 samples/second), it is necessary that the 
system is able to finish all the computations required to determine the output at 
time instant n before the next sample, x[n + 1], arrives. For obvious reasons, mul- 
tiplication is much more costly to perform compared to addition. Sometimes, the 
number of delay elements is also considered while specifying the complexity. 


10.7.2 Recursive and Non-recursive Digital Systems 


Systems whose output depends on several past outputs as well as the present and 
several past inputs are called recursive systems. Equation (10.45) represents a causal 
and practically realizable recursive system. If y[n] depends only on the present and 
past inputs, then 


yin] = D [x[n], x[n — 1], ..., x[n — M]]. (10.48) 


Such systems are called non-recursive. 


10.7.3 Transfer Function 


Transfer function (denoted as H(z)) of a LTI system is given by the ratio of the 
z—transforms of its output to input. That is 


A(z) = i (10.49) 


where X (z) is the z-transform (ZT) of the input x[n] and Y (z) is the’ ZT of the 
output y[n]. 


7. Using Eq. (10.21), we can determine the ZT of the output, y[7], of a LTI system with impulse response, 
A[n], as (with p = n — m) 


Y(z) = > yia] = 5 a x[m]h[n — m]z~" 
=>) Dd xp P= YD npk? DY xime™ 
p=—00 m=—00 p=- m=—0o 
= H(z)X(z). (10.50) 


Thus, we get the transfer function, H (z), as defined in Eq. (10.49). 
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Recall from Chapter 8 that? Z[x[n — k]] = zE X (2). Using this and the lin- 
earity property of ZT, we can obtain the transfer function of the system given by 
Eq. (10.47) as follows: 


Y(2) = Z [5v[n] + 6v[n — 1] + 7o[n — 211 
= 52Z[olnll + 62 [ola — 1 + 7Z [of — 201 
= 5V(z) + 6271 V (2) + 727° V (2) 
2 [s rer +7] V2) (10.51) 
Ve) = Z kin] — 3oln — 1] —4o[n — 2] 
= X (z) — 327! V(z) — 42-7 V(z) 


> X(Z)= [i +3z7! +4277] V(z) (10.51b) 
x 
Ve) = E rem (10.51c) 


oY) _ 5+ 62-1! + 72-7 


= = 10.51 
X(z)  14+3z7!+4z-2 nore) 


=> H(z) 


Using Eq. (10.51d), we can obtain another difference equation for the output as 
follows. Using Eq. (10.51d), we can write 


[1 + 3z 44 4c? Y(z)= [s +6z7! + 727! X (z) 
=> Y(z)+3z!¥(z) +42 °¥ (2) = 5X (z) + 62 X(z) 
+7277? X (2). (10.52a) 
Taking inverse ZT on both sides of Eq. (10.52a), we get 
y[n] + 3y[n — 1] + 4y[n — 2] = 5x[n] + 6x[n — 1] + 7x[n — 2] 
=> y[a] = 5x[n] + 6x[n — 1] + 7x[n — 2] 


— 3y[n — 1] — 4y[n — 2]. (10.52b) 


The expression for the output, y[n], given by Eq. (10.52b) is recursive in nature, as 
y[n] depends on its own past values. 


> 


8. The notation Z[x[n]] implies ‘the z-transform (ZT) of x[n] 
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Eq. (10.51d) shows that, in general, we can express the transfer function of a 
digital system as the ratio of two polynomials in z as 


M 
S bz i 
N = 
H(z) = a no (10.53) 
az * 
k=0 


where b; for] = 0,1,..., M, and a, fork = 0,1,..., N, are the coefficients 
of the polynomials N (z) and D(z), respectively. Note that these coefficients corre- 
spond to the multiplication factors in the block-diagram’ of the system. 


10.7.4 Poles and Zeros 


The values of z at which H(z) becomes infinity are known as the poles of H(z). 
Similarly, the values of z at which H(z) becomes zero are known as the zeros 
of H(z). Therefore, the poles and zeros of H(z) can be obtained by determining 
the roots of its denominator and numerator polynomials, respectively. Since H (z) 
becomes 00 at its poles, it is clear that all the poles of H(z) must lie outside its 
ROC. 

For the H(z) given in Eq. (10.51d), we get the poles as {(—1.5 + 
J1.323), (—1.5— j1.323)} and zeros as {(—0.6+ j 1.02), (—0.6— j 1.02)}. It can 
be seen that both the numerator and denominator polynomials are of 2nd degree 
and hence there exits two roots each. Note that the poles and zeros occur in complex 
conjugate pairs since the polynomial coefficients are real. 

A plot of the poles and zeros is known as the pole-zero diagram. The pole-zero 
diagram for the system in Eq. (10.51d) is illustrated in Fig. 10.11. It can be seen 
that both the poles and zeros lie outside the unit circle. 


§ From the pole-zero diagram of a transfer function, is it possible to obtain the expression 
for the transfer function? 


Poles of Causal and Stable LTI Systems: Let us consider a causal LTI system with 
impulse response given by h[n] = a” u[n], where a isa scalar. Recall from the exam- 


oe ee 
Zaz T’ 


which has one pole at z = a and ROC is given by |z| > |a|. Thus, the ROC does 
not include the pole. On the other hand, recall that the ROC ofa stable system must 


ple on the right-sided sequence in Section 8.1, that this results in H(z) = i 


9. Will be discussed in detail in the next chapter. 
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Figure 10.11. Pole-zero diagram. Here, the poles are denoted by xs and zeros are denoted 


by os. 


include the unit circle. This implies that we should have |a| < 1 for this system 
to be stable. In other words, the poles of a causal and stable system must lie inside the 
unit circle. 


10.7.5 Frequency Response 


Frequency response (denoted H(f)) of a LTI system is given by the Fourier trans- 
form of its impulse response, h[n]. It can also be obtained by evaluating the transfer 
function, H(z), on the unit circle. That is, 


Y() YD 
X (z) geen f X(f) 


> Alnje 7", (10.54b) 


I 


H(f) = H) ejz} = (10.54a) 


I 


Thus, frequency response is equal to the ratio of the discrete-time Fourier trans- 
forms (DTET) of the output and input. It is easy to see that H (F) is periodic with 
period equal to the normalized sampling frequency 1 (Note: X(f) and Y(f) are 
periodic). 

We say that a digital system is real if the coefficients of the numerator and 
denominator polynomials (N (z), D(z)) in its transfer function are real. This is 
equivalent to saying that the impulse response, h[n], is real, i.e., h*[n] = h[n]. 
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Noting that (ei f) = e~)*f, we can write using Eq. (10.54b) 


H*(f)= b mnie=? t] = Shin] (rP) 
= > hine’? f” — Hf), 10.55) 


Thus, for real systems, the magnitude of H (f) is even-symmetric and phase of 
H(f) is odd-symmetric. That is, 


IH(fl=|H(-f)| and 6(—f) = o), (10.56) 


where 0(f) is the phase of H(f). As before, |H(f)| and 6(f) are known as the 
magnitude spectrum and phase spectrum, respectively, of the system specified by 
the transfer function, H(z). 


10.7.6 Impulse Response 


By definition, we get the impulse response as the system output (i.e., y[n] = h[n]), 
when we set the input as x[n] = d[n]. That is, 


X(z)=1 and = X(f)=1. (10.57) 
Using this in Eqs. (10.49) and (10.54), we get 
Y(z)=H(z) and Y(f)=H(f). (10.58) 


Thus, the impulse response (denoted as h[n]) of a system can be obtained by 
finding 


e either the inverse DTFT of its frequency response, H (f), 
e or the inverse ZT of its transfer function, H(z). 


That is, 


0.5 3 
hin] = F—'LH(f)] = He df. (10.59) 
F 5 


h{n] = Z7'[H(z)]. (10.60) 
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10.7.7 Systems with Finite-Duration and Infinite-Duration 
Impulse Response 


It is possible to subdivide the class of LTI systems into two types: Finite-duration 
impulse response (FIR) and Infinite-duration impulse response (IIR). Thus an FIR 
system has an impulse response which is zero outside some finite interval. Without 
loss of generality, we focus our attention on causal FIR systems, so that 


h[n] =0, n<0O andn>M. (10.61) 


The convolution formula for such a system reduces to 
M-1 
yin] = So Alklx[n — k]. (10.62) 


k=0 


In contrast, an IIR LTI system has an infinite duration impulse response and the 
output (convolution formula) is, 


y[n] = Š hiklx[n — k]. (10.63) 


k=0 


10.8 Determination of System Output 


Consider a LTI system with impulse response h[n] and transfer function H (z). It 
becomes often necessary to determine the output, y[n], of the system for a given 
input, x[n]. We can do this by any of the following methods. 


e ‘Transfer Function Approach: From H(z) (the transfer function) and X (z) 
(z-transform of the input, x[n]), the z-transform of the output, Y(z) is 
obtained as Y (z) = H(z)-X(z). The corresponding output y[n] is obtained 
by taking the inverse ZT of Y (2). 

e Frequency Response Approach: Given H(f), we can determine y[n] by 
finding the inverse DI FT of H(f)X(f). 

e Convolution Approach: Given h[n] and x[n], the output is calculated as, 
yin] = h[n] @ x[n]. 

e Difference Equation Approach: Given H(z), we can form the difference 


equations and determine the output, y[7], as illustrated by Eq. (10.52). 
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10.8.1 Transfer Function Approach 


Since Y (z) = H(z)X (2), if we are given the system transfer function (H (z)), we 
can obtain the output, y[n], by determining the inverse ZT of H (z)X (z). Often, 
this is not an easy task, since the expression H (z)X (z) may not be simple enough 
to write its inverse ZT by inspection. This occurs when Y (z) has two or more poles 
(i.e., denominator is of degree 2 or more). In such cases, we resort to the method 
partial fractions as described in Chapter 8 (see Section 8.5.2). 

Let Y(z) be a complicated expression whose inverse ZT we want to find. The 
method of partial fraction determines scalars a1, 42, +++, @m such that Y(z) can 
be written as, 


Y (z) = a1 Y1 (z) + a@2Y2(z) +--+ + amYm(z), (10.64) 


where Yj (z), Y2 (2), -+ +, Ym (2) are simple expressions whose inverse transforms are 
known. Then, we can get the inverse ZT of Y (z) as, 


yin] = aiyiln] + azyz[n] +--+ + amYm[n] (10.65) 


where y;[n] is the inverse ZT of Y; (z) fori = 1,2,...,m. The scalars a1, a2, 
-+, &m can be determined by following the method we outlined in Chapter 8. 


Determination of Impulse Response, h[n]: In some applications, we may want to 


determine the impulse response, A[n], of the system. As Eq. (10.60) shows, we can 
obtain h[n] by finding the inverse ZT of H (z). If H (z) is nota simple function (i.e., 
it has more than one pole), we can use the method of partial fraction to obtain h[n]. 


10.8.2 Convolution Approach 


Given h[n], we can determine y[n] by convolving h[n] with x[n] as (see 
Eqs. (10.21) and (10.22)) 


CO o0 


yla] = >) ximlhin- m= $ himin -— m]. (10.66) 


m=—OO m=—OO 


We have also seen that (see Eq. (10.50)) convolution in time-domain is equivalent to 
multiplication in frequency-domain, as given by 


Y@)=H(Z)X(z) of Y(f)=H(f)X(f). (10.67) 
These relations are very useful while working with signals and systems. 


10. While applying the partial fraction approach, we must ensure that the expression for Y (z) is a proper rational 
function. That is, the degree of the numerator polynomial is less than that of the denominator. 
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The dual of the relations in Eqs. (10.66)—(10.67) arise when we consider mul- 
tiplying two signals in time-domain. Recall that the multiplication in time-domain 
results in convolution in frequency-domain. That is, if y[n] is obtained as y[n] = 
x[n]h[n], then we have 


Y(Ď = Fix[nJh[n]] = X( 8 H(f) (10.68) 
0.5 
= I X(u)H(f —u)du (10.69) 
—0.5 
0.5 7 
= H(u)X(f —u)du. (10.70) 
—0.5 


Since X(f) and H(f) are periodic, the convolution depicted by Eqs. (10.68)- 
(10.70) are known as circular convolution. This is because, the H(f — u) and 
X(f — u) are equivalent to circularly shifting one period of these spectra. As a 
result, for any value of f in Y(f), the integration involves one complete period 


each from both X(f) and H(f). 


10.8.3 Difference Between Linear and Circular Convolutions 


Let a[n] and b[n] be N-point data sequences which are zero for n outside 


{0, 1,..., N — 1}. The linear convolution between a[n] and b[n] is given by 
N-1 
piln] = a[n] 8 bin] = >) aba — 1) (10.71) 
1=0 


where a[n] = 0 and b[n] = O ifn ¢ {0,1,..., N — 1}. The circular convolution 
between a[n] and b[n] is given by, 


N-1 


pain] = a[n] © bin] = >) abn — 1) (10.72) 
1=0 


where G@[n] and b[n] are obtained by periodically extending a[n] and b[n], respec- 
tively. 


10.9 Concluding Remarks 


We conclude this chapter with the following remarks. 


e Digital signal processing plays a very important role in many practical appli- 
cations involving signals and systems. 
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Linear time-invariant (LTT) systems can be characterized by impulse response, 
frequency response, transfer function, etc. 

Output of a LTI system can be obtained by convolving its impulse response 
with the input. 

Convolution in time-domain is equivalent to multiplication in frequency- 
domain, and multiplication in time-domain is equivalent to convolution in 
frequency-domain. 

A LTI system is stable if and only if the unit circle is inside the region of con- 
vergence of its transfer function. This is equivalent to saying that its frequency 
response must exist (be finite) for all frequencies. 

A causal LTI system is stable if and only if all the poles of its transfer function 
lie inside the unit circle. 

Physical realizability requires stability and causality. 


Exercises 


10.1. The output y[n] of a digital system is related to its input x[n] by, 
y[n] = 0.98 y[n — 1] + 0.02x[n]. 


Find the system transfer function H(z) and the impulse response h[n]. 
10.2. The transfer function of a digital system is given by, 


0.03 


Ho=—— 
@) = T9071 


Sketch the magnitude response for | fl < 1 Hz. Is H(z) a low-pass 
system? 

10.3. In a biomedical engineering system, the power (p[n]) of the real signal 
x[n] is determined as 


pin] = 0.02 [xn] + 0.98x?[n — 1] + 0.98?x?[n — 2] +... | 
Show that this is equivalent to squaring x[n] and passing this x?[n] into 


a filter with transfer function H (z) given by, 


0.02 


H(z) = ——__.. 
©) = T9081 


10.4. The output y[n] of a digital system is related to its input x[n] by the 
following difference equation: 


y[n] = 0.98y[n — 1] + 0.02x7[n]. 
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10.5. 


10.6. 


10.7. 


10.9. 


If x[n] is a real white noise sequence with power (p[n]) 3, find the mean 
value of y[n] in the steady state. 
The transfer function (H (z)) of an all-pass system is given in the equa- 
tion below. 
1 — 0.8z 
H(z) = ——— 
2 z= 08 
(a) Plot the pole-zero diagram and the magnitude response of the sys- 
tem. 
(b) Determine the phase response of H(z) in Question (a) and check 
if it is negative over the positive main band. 


The impulse response h[n] of a digital system is as shown below: 


1 for 2<n<4 
0 otherwise, 


h[n] = | 


Find the output y[n] of the system for the following input x[n]: 


1 for O<n<2 
0 otherwise, 


x[n] -=| 


For a digital system, the impulse response h[n] = ô[n — 2]. Find the 
output y[n] of the system for the given input x[n]: 


1 for n=0,2 
x[n] = 42 for n=1 
0 otherwise, 


. The response y[n] of a digital system to an impulse input (i.e., x[n] = 


ô[n]) is given by, 


1 for n=0 
y[n] = 42 for n=1 
0 otherwise. 


Find the impulse response (h[n]) and frequency response (H ( f)) of the 
system. Using convolution, find the output of the system if the input is 
x[n] = elr fin, 

We would like to implement an ideal low-pass filter with frequency 
response H (f) as shown in Fig. P10.9 below. Find the impulse response 
h[n] of the filter. Express y[n] in terms of h[n] and the input x[n]. Is 
this filter implementable? 
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10.10. 


10.11. 


10.12. 


Digital Systems 


i H(f) 


x[n] yin] 


-0.5 -02 0 02 0.5 f 


Figure P10.9. Frequency response of ideal low-pass filter. 


Two digital linear systems with system impulse responses hy[n] and 
h2[n] are connected in parallel as shown in Fig. P10.10. Here x[n] is 
the input to the system and y[n] is the overall output of the system. 
yi[n] is the output of the first system to the input x[n] and y2[n] is the 
corresponding output from the second system. Find the overall impulse 
and frequency responses (h[n] and H ( fa ), respectively) of the system. 


yilin] 


yən] 


Figure P10.10. Parallel connection of two digital linear systems. 


Figure P10.11 shows the cascading of two linear digital systems with 
impulse responses hı [n] and h2[n], respectively. Here x[n] is the input 
to the system and y[n] is the overall output of the system. yı[7] is the 
output of the first system to the input x[n] and y[n] is the output from 
the second system whose input is the output y;[”] from the first sys- 
tem. Find the overall impulse and frequency responses (h[n] and H (F), 
respectively) of the system. 


x[n] yla] yin] 


Figure P10.11. Cascading of two digital linear systems. 


A FIR (finite impulse response) system has an impulse response h[n] 
(given below) that is finite in length and symmetrical about the centre. 
Find its magnitude response (|H(f)|). Show that it is a linear phase 
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system or arg[H(f)] x f> where f is the frequency. 


5 for n=0,3 
h[n]= 7 for n=1,2 
0 otherwise. 


10.13. A causal system is one whose output y[n] depends on the present input 
x[n] and its past values x[n — 1], x[n — 2],.... A non-causal system 
has output that depends on future inputs and is not implementable. Is 
H(z) = 4z + 1 +227! + 3z7° causal? 

10.14. A system has input x[n], output y[n], and H(z) = 5z 142z? 
3z73. The system is not causal as H (z}’s expansion has 5z? term. Can 
the system be made causal and implementable by adding delays? 

10.15. The decimator (with a compression ratio of 2) shown in Fig. P10.15 is 
used to reduce data rate and the sampling frequency from 8 to 4 Hz. 


x[n] x[i] [2] x[3] x14] yin af] x[3] 


n 0 n 


0 


j 


Þe = 


2 3 
2 3 
= 8 j Q 


Figure P10.15. Decimator (compression ratio 2). 


(a) Show that ¥(f) = 0.5 [x n x(f+4)]. 
(b) From Y(f) = 0.5 [x/) XG + 4) | above, draw the input and 


output spectra. 


10.16. The operation of a digital filter with impulse response hy [n] and a trans- 
fer function Hy (f) is described by the following difference equation: 


l N 
yin] = xin] - > Do xin — k], 


k=1 


where x[n] is the input signal to the filter, y[n] is the output and N is a 
positive constant. 


(a) Find and sketch the impulse response of the filter, hy [n], when 
N = 1 (we, Ay[n]) and N = 2 (i.e., A2[n]). 

(b) Write down Hy (f) and sketch | H1 (f)| in the frequency range 0 < 
f < fs/2, where fs is the sampling frequency. 

(c) The operation of the filter can be verbally described as: “Subtrac- 
tion of the moving average of the last N samples from the newest 
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sample of x[n]”. Describe qualitatively how | Hy (f )| changes with 
increasing N. 


10.17. In this exercise, we will consider a device for recording the electrical 


signals from the heart (electrocardiogram, ECG). Simplified periodic 
signals are used in the development of the device. These signals are given 


by: 


g(t) = gilt) + g2(t) + 23(t), 


where 
asin(2a fit) for Tı <t <2.5T; 
gıt) = 0 coat 
otherwise 
bsinQQafit) for 1.57, < t < 2T 
g2(t) = 
0 otherwise 
csin(2a fot) for 47, < t < 47, +0.57 
g3) = , 
0 otherwise, 


where the signals g1 (t), g2(t), g3(t), and g(t) are all periodic with a 
period T = 1s. Furthermore, we have the following periods: Ti = 1/fi 
and T2 = 1/f2, where fi = 8Hz and f2 = 2Hz. A single period 
of the signal g(t) is shown in Fig. P10.17 (top) and the corresponding 
amplitude spectrum is shown in Fig. P10.17 (bottom). It is assumed that 
the spectral component above 90Hz are negligibly small. 


g(t) 


0 0.2 0.4 0.6 0.8 1 
Time (Seconds) 


IG(F)| 


0 20 40 60 80 100 
Frequency (Hz) 


Figure P10.17. Signal g(t) (top) and its Amplitude spectrum |G(f)| (bottom). 
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(a) 


(b) 


Express the power of the signal g(t) as a function of a, b, and c, 
and suggest a sampling frequency such that there is an equivalence 
between the analog and the discrete-time periodic signals. 

We assume in the following, that the noise generated by the mea- 
surement process has negligibly little power, and is without any sig- 
nificance. The sampling frequency is chosen to be 200Hz, so that it 
is suitable for the consequent signal processing steps. A 50Hz inter- 
ference signal is also present in the measured signal. It comes from 
the electric power net, and it should be removed by means of digital 
signal processing techniques. The following digital filter is used for 
the purpose: 


h[{n] = o[n] — hy[n], 
where 
x cos(2z f3nT;) for O<n<2M-1 
hi[n] = 
otherwise, 


where f3 = 50Hz, Ts is the sampling period and M is a positive 
integer number. Write down the transfer function of the filter, and 
show that it removes the spectral component at 50Hz. Explain the 
influence of the filter’s length 2M on its transfer function. 


10.18. An analog signal of biological origin can be described by the following 


expression: 


golt) = g(t) x cos(2z for), 


where fo is a constant, and g(t) is a real signal, that can be seen in 
Fig. P10.18(a). g(t) has a complex spectrum G(f), and |G(f)| is 
shown in Fig. P10.18(b) for positive frequencies (i.e., f > 0). Only the 
portion of the spectrum, in which the spectral components |G(f)| have 


significant value (> 0) is depicted. After doing some measurements, it 


can be concluded that |G(0)| = A, |G(50)| = A/5, and To = 100 ms. 


(a) 


Give an expression of how to find A from g(t), and give reasons 
why A # 0. Provide a labeled sketch of the spectrum of go(t) 
by labelling the appropriate amplitude and frequency values, when 
fo = 1750Hz. 
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g(r) 
m< To 0 To t 
(a) 
lED] 
A 
0 20 40 60 80 100 120 (Hz) 
(b) 


Figure P10.18. (a) Signal g(t) (b) Complex Spectrum. 


(b) A mathematical model of the signal g(t) is needed for experiments. 
The modelled signal (denoted as gq(t)) is chosen to be: 


Salt) = gi(t) + 820), 


where 
_ jasinQzfit) for |t| < To 
810) = k otherwise, 
and 
_ Jb for |t| < To 
820) = lo otherwise. 


In these expressions, a, b, and fı are constants. The magnitude 
(the value) of 279 fı is a suitable integer number. The spectrum of 
8a(t) is denoted as Ga( f). Show that the real part of Ga(f) is 
dependent only on g2(t), and that the imaginary part of Ga(f) 
is dependent only on g1 (t). Give an expression for calculating the 
energy of g(t), and show that its energy is the sum of energies of 
gi(t) and g2(¢). 

(c) Argue that 50Hz will be an appropriate choice for fı. Next, cal- 
culate the ratio between a and b for this value of fi, so that 
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|Ga(f)| becomes a reasonable approximation of |G(f)| for fre- 
quencies f = 0 and f = 50Hz. 

(d) g(t) is converted to the discrete-time signal gg[n], which has a com- 
plex spectrum Gg(f). The sampling interval is T; = 4ms. Find 
the sampling frequency and sketch |Ga(f)| in the frequency range 
below 500Hz (i.e, 0 < f < 500). Discuss whether the condi- 
tions in the sampling theorem are fulfilled. Discuss if other values 
for T; can be chosen, such that there is equivalence between g(t) 
and gq[n]. 


In this exercise you will create a robust scheme to additive noise edge 
detector. In many applications, the edge of the pulse must be detected. 
Other applications require the removal of the low frequencies present 
in the signal. In both cases this can be done by a system with impulse 
response hı [n] which performs differentiation on the incoming data: 


y[n] = x[n] — x[n — 1], 


where x[n] is the input and y[n] is the output of the system. A slightly 
more sophisticated version is the system with an impulse response h2[n] 
which processes the incoming signal as follows: 


y[n] = x[n + 1] — 2x[n] + x[n — 1]. 


(a) Provide labelled sketches of the impulse responses h1 [n] and h2[n]. 
Sketch also their transfer functions Hı (f) and H2(f) in the fre- 
quency range fe {-3, x}, where f is the normalized digital 
frequency, i.e, f = £ (fs is the sampling frequency). 

(b) Show that hafn] = hy[n] Q hiln + 1], where & denotes the con- 
volution. [Hint: You may want to use the equivalence between con- 
volution in time domain and multiplication in frequency domain 
combined with the rule for time-shifting.] 

(c) The input x[n] to a system is often corrupted by additive noise as 
illustrated in Fig. P10.19(a). In this figure, the output of the system 
is y[n] = x[n] © hln]. The input is x[n] = p[n] + d[n], where 
p(n] is the signal of interest and d[n] is the additive noise. 

Assume that the input to the system, p[n] is as shown in 
Fig. P10.19(b) and that there is no noise, i.e., d[n] = 0. Provide a 
labeled sketch of y[n], the output of the system. 

(d) Assume that the input to the system p[n] is the same as in Question 
10.19(c). Let there be noise this time, d[n] = —d[n + 1]. Sketch 
the output of the system for x[n] = p[n] + d[n]. 
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pln] yin] 


pin] 


(b) 


Figure P10.19. 


(e) To remove noise, a filter with impulse response hs[n] is placed 
before h2[n] as shown in Fig. P10.20(a). The impulse response 
hs[n] is shown in Fig. P10.20(b). 


(b) 


Figure P10.20. 
Sketch the output of the combined system for the same input 
signal as in Question 10.19(c). 


10.20. A MP3 player implements a simple tone control function by passing 
an audio signal, x[n], into a linear filter with filter function Hı (z) = 


ERE to produce yı [n]. Subsequently, this yı [7] is passed through 
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a second linear filter, H2 (z) = (1 — z7!), to produce y2[n]. By sketch- 
ing their magnitude responses, determine whether the two outputs will 


enhance the bass or treble of the input. 


Consider the five pole-zero diagrams in Fig. P10.21. Each plot corre- 
sponds to a discrete-time linear time-invariant (LTI) system function, 


whose unit sample response is real. Each plot is drawn to scale. (Note that 


-0.5 


Re | 


Sm 


Re 


0 0.5 1 


ta 


(e) 


0 0.5 1 Lo 


Figure P10.21. Pole-zero diagrams. 
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you have all the information to solve the equations in this problem, although 
some of the poles and zeros are not labelled). 


(a) Which plot(s) can have a region of convergence (ROC) so that it 
corresponds to a causal and stable system? Explain. 

(b) Consider the block diagram shown in Fig. P10.22. H(z) is 
described by one or more of the pole-zero plots A — E from 
Fig. P10.21. G(z), which does not correspond to any of the pole- 
zero plots A — E is a system such that w[n] = x[n]. 


w[n] =x[n] 


Figure P10.22. Cascaded systems. 


(c) Which plot(s) correspond to H(z) such that both H(z) and G(z) 
are causal and stable? Explain. 

The block schematic of a LTI digital system is shown in Figure P 10.23. 

Here x[n] and y[n] are the input and output, respectively of the system 

and h[n] is the system impulse response. The system is described by the 

difference equation, y[n] = x[n] — ax[n — 1]. Here, a is a real scalar 


x[n] yin] 


Figure P10.23. 


variable. 


(a) Determine the system function, H (z) = x2 and hence derive its 


impulse response, h[n]. Here, X (z) and Y (z) are the z—transforms 
of x[n] and y[n], respectively. 
Figure P10.24 below shows the block diagram (arranged in parallel 
structure) of a causal LTI digital system with one input, x[n], and one 
output, y[n]. In the figure, z~! represents a unit sample delay. 


(a) Derive the transfer function, H(z) = ar for the given system. 
Find also its impulse response, h[n] (Hint: Use the rule in finding 
the overall system function, H (z) of systems connected in parallel). 

(b) Draw the transposed direct form II structure of the system and ver- 
ify that both the original and the transposed system have the same 
transfer function. 

(c) Draw the pole-zero diagram of the system and comment on its sta- 


bility. 
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Figure P10.24. 


10.24. The z—plane pole-zero diagram for a certain digital system is shown in 
Fig. P10.25. The system has unity gain at DC (i.e., H(z) = 1 atz = 1). 


Figure P10.25. 


(a) Determine the system function, H (z) in the form 


H@=A É +ayz7') (1 +biz™! + | 


(1 + e127!) (1 +.dyz-! + d2z7?) 
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giving numerical values for the parameters A, a, b1, b2, c1, d1, and 
dz (Please note that the parameter, A in H(z) is to set the DC gain 
of H (z) to unity). 

Draw the direct form II (canonic form) structure of the complete 
system. 

Draw the cascade form structure of the system. Make each sec- 
tion canonic, with real coefficients. Also, make sure that the max- 
imum order of the sections in cascade form to be two (i.e., 2nd 
order systems) (Hint: Consider H(z) in Question 3.1 as, H(z) = 
A Hı (z) A(z), with the numerical values of the parameters substi- 
tuted. Here, Hı (z) is a first order recursive system and H(z) is a 
second order recursive system). 


Consider the implementation of a causal linear time-invariant (LTT) 


recursive system as shown in Fig. P10.26. Here x[n] and y[n] are the 


input and output, respectively of the system. In the figure, the symbol 


z7! denotes a unit sample delay and Q is a positive number < 1 (i.e., 


0 < Q < 1). The system is assumed to be “at rest”, i.e., y[n] = O for 
n <0. 


(a) 


(b) 


yin] 


Figure P10.26. 


Show that the output y[n] = D/Q for large values of the time 
index n when the input x[n] = D, where D is a positive constant. 
(Hint: Find y[n] for n = 0, 1,2, ..., etc., and develop a general 
series expression for y[n], in terms of D, Q, and n. The requested 
solution can be derived from this.) 

Find the impulse response, h[n] = I ZT {H (z)}, of the system and 
prove that the system in Figure P1 is stable if Q is in the range 
0 < Q < 1. IZT here refers to the inverse z—transform and H (z) 
is the system transfer function. 
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(c) Determine the frequency response, H (f), of the system in Figure 
P1 and show that its DC (0 Hz) gain, H(0), is in the range 1 < 
H (0) < oo for a given value of Q. 

Figure P10.27 shows the block diagram of a causal LTI digital system 

with one input, x[n], and one output, y[n]. In the figure, z~! represents 

a unit sample delay. 


N 


x[7] yin] 


“i 


Figure P10.27. 


(a) Derive the transfer function, H (z), for the given system, sketch the 
pole-zero distribution in the z-domain and comment on its stability. 

(b) Draw the direct form-I implementation structure of the given sys- 
tem. 

(c) Reconfigure the system implementation structure in the standard 
canonic (direct form-II) form and draw it. 

(d) Determine the system response, y[n], to an input x[n] = 
(3)" u[n], where u[n] is the discrete-time unit step function defined 


as, 


1 for n>0 


u= F for n <Q. 


Figure P10.28 shows the complete block diagram representation ofa LTI 
system. Here X(z) and Y(z) are the z—transforms of the input (x[n]) 
and output (y[7]), respectively of the system. In the figure, z~! repre- 
sents a unit sample delay and K, a, p, and y are scalar constants. W1, 
W2 and W3 in the figure are temporary (intermediate) variables. 

In the following, the value of y is chosen to be —1. 


(a) Determine the system function H(z) = x2. 


(b) Is the structure provided in Fig. P10.28 canonic? If not, draw the 
canonic structure of the given LTI system. 
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(c) 


(d) 


Figure P10.28. 


What should be the value of the multiplier coefficient K so that 
H (z) has unity gain (i.e., all-pass) in all the frequencies. 

Ifthe values ofa = 1, p = 0.5, y = —1 and K is chosen to be the 
one obtained from Question (c), sketch the pole-zero distribution 
in the z-domain and comment on the stability of the system. 


10.28. A researcher uses the derivative operator (filter) specified as w[n] = 


x[n] — x[n — 1], where x[n] is the input and w[n] is the output of 


the filter. The result is then passed through the moving-average (MA) 
filter given by y[n] = 5 [w[n] + w[n — 1] + w[n — 2]], where y[n] is 
the final output desired. 


(a) 
(b) 


(c) 
(d) 


Derive the transfer functions (in the z—domain) of the two filters 
individually as well as that of the combination. 

Derive the impulse response of each filter and that of the combina- 
tion. Plot the three signals. 

Does it matter which of the two filters is placed first? Why (not)? 
The signal described by the samples 

x[n] = {..., 0,0, 0, 6, 6, 6, 6, 6, 6, 6, 6, 0,0, ...} is applied to 
the system. Here the first non-zero input corresponds to n = 0. 
Derive the values of the final output signal. 
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Chapter 11 


Implementation of Digital Systems 


This chapter focuses on the realization of LTI discrete-time systems either in 
software or hardware. Various structures for the realizations of FIR and IIR discrete- 
time systems are discussed in detail. Some of the important structures are the cas- 
cade, parallel, and lattice structures. A computationally efficient frequency-sampling 
realization of FIR system is also included in the discussion. 


11.1 Structures for the Realization of Discrete-Time 
Systems 


The important class of LTI discrete-time systems characterized by the general con- 
stant coefficient difference equation is considered here. 


N M-1 
yin] = — Do agy[n — k] + > bexin — k]. (11.1) 
k=1 k=0 


By taking the z—transform of Eq. (11.1), the LTI system can also be characterized 
by the rational system function as, 


M-1 =f 
o bkz 
He È k0 k 


= , (11.2) 
1+ Di ayz—* 
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which is a ratio of two polynomials in z~!. From Eq. (11.2), we obtain the zeros and 
poles of the system function, which depend on the choice of the system parameters 
{ap} and {bz}. These parameters also determine the frequency response characteris- 
tics of the system. In this chapter, we shall show that Eq. (11.1) and Eq. (11.2) can 
be implemented in different ways depending on the form in which these two char- 
acterizations are arranged. The major factors that influence the choice of specific 
realizations are the computational complexity, memory requirements, and finite-word- 
length effects in computations. 

The implementation of digital systems (both FIR and IIR types) require three 
basic operations: (i) multiplication, (ii) addition, and (iii) signal delaying. 

The structures for FIR systems are described first followed by the structures 
for IIR systems. Alternative structures for both FIR and IIR systems are discussed 
towards the end of this chapter. 


11.2 Structures for FIR Systems 


The FIR system is described by the difference equation 


M-1 
yin] = >) bextn — k], (11.3) 
k=0 


or, equivalently the system function 


M-1 
HQ) = Do bee. (11.4) 
k=0 


The unit sample response (impulse response) of the FIR system is identical to 
the coefficients {bg}, that is, 


ba, forO<n<M—l1, 


0 Otherwise (11.5) 


hin] = | 


The implementation/realization schemes’ discussed in the following sections 
are: 

e Direct form realization, 

e Cascade form realization, 


1. The FIR system can be realized by the discrete Fourier transform (DFT) method as well. 
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xin] 


Figure 11.1. Direct-form realization of FIR system. 


e Frequency-sampling realization, and 
e Lattice realization 


11.2.1 Direct-Form Structure 


This structure (illustrated in Fig. 11.1) follows immediately from the non-recursive 
difference equation (Eq. (11.3)) or, equivalently by the convolution summation 


M-1 


yin] = $ hlkixin — k]. (11.6) 


k=0 


It may be noted that the direst form structure requires M — 1 memory locations, 
M multiplications and M — 1 additions per each output point. It is also known as 
transversal or tapped-delay-line (TDL) structure. 

When the FIR system is linear-phase, then h[n] = +h[M — 1 — n]. If h[n] = 
+h[M — 1 —n], it is called an even symmetric linear phase FIR system and if h[n] = 
—h[M — 1 — n], it is called an odd symmetric linear phase FIR system. 

Expanding Eq. (11.6), we get the difference equation relating the input x[n] 
and output y[n] of the FIR system, 


yin] = h[O]x[n] + h[1]x[n — 1] +...+h[M — 1]x[n— M — 1]. (11.7) 


For an even symmetric linear phase FIR system, the summation in Eq. (11.7) 


can be written as, 


yin] = h[0] [nm] + x[n — M — 1)) + h[1] (x[n — 1] + x[n —-M—2])+.... 

(11.8) 

The direct form realization/implementation of the system in Eq. (11.8) is shown 

in Fig. 11.2, where the order of the filter M is odd. It can be seen that the number 

of multiplications is reduced to M /2 when M even and (M — 1)/2 when M odd. 
The number of delay (memory) units remain the same in both the structures. 
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Figure 11.2. Direct-form realization of linear-phase FIR system when M Odd. 


11.2.2 Cascade-Form Structure 


This realization follows from the system function in Eq. (11.2). The system func- 
tion is arranged in such a way that it becomes the product of several 2nd order FIR 
systems as, 


K 
H(z) = | | A), (11.9) 
k=1 


where 
Ay (z) = bro + briz! + bez’, 4k =0,1...,K (11.10) 


and K is the integer part of (M + 1)/2. The filter parameter bọ may be equally 
distributed among the K filter sections, such that bp = b10b20 .. . bgo or it may be 
assigned to a single filter section. The zeros of H (z) are grouped in pairs to produce 
the second order FIR systems of the form in Eq. (11.10). It is always desirable to 
form pairs of complex-conjugate roots so that the coefficients {bxi} are real valued. 
If the roots are real-valued, they can be grouped in any manner. The block dia- 
gram representation of the cascade form realization (Fig. 11.3(a)) along with the 
basic second-order section (Fig. 11.3(b)) are shown in Fig. 11.3. The second-order 
section is the implementation of Eq. (11.10). 

In the case of linear-phase FIR filters, the symmetry in h[n] implies that the 
zeros of H (z) also exhibit a form of symmetry. In particular, if zg and z% are a pair 
of complex-conjugate zeros, then + and z are also a pair of complex conjugate 


zeros (see Fig. 11.4). Consequently, we gain some simplifications by forming fourth 
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x{r)]= ln] -—— vidil- xan] yall) yelni] xei) ylnl= yin] 


(a) 


YL] = že [7] 


(b) 


Figure 11.3. Cascade-form realization of a FIR system (a) and realization of each second 
order section (b). 


Figure 11.4. Symmetry of zero locations for a linear-phase FIR filter. 


order sections of the FIR system 


Hy (2) = cro(l — zee!) — ez) (: - e) (1 - že), 


Zk 


= cgo + ckiz T! + egoz? + ceiz > + croz}, 


= coll +274) + ca (27! + 27) + cz’, (11.11) 
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Figure 11.5. 4“"-order section in cascade-form realization of an FIR system. 


where the coefficients {cx1} and {cx2} are functions of zg. Thus, by combining two 
pairs of zeros to form a fourth order filter section, we have reduced the number of 
multiplications from 6 (for two second-order systems) to 3. Figure 11.5 illustrates 
the basic fourth-order FIR filter structure (implementation of Eq. (11.11)). 


11.2.3 Frequency-Sampling Structure 


This is an alternative structure for a FIR filter in which the parameters that char- 
acterize the filter are the values of the desired frequency response instead of the 
impulse response h[n]. To derive the frequency sampling structure, we specify the 
desired frequency response at a set of equally spaced frequencies, namely, 


k=0,1,...,.444, M odd, 
— 11.12 
‘va is (11.12) 


k=0,1,...,5 , M even 


and solve for the impulse response h[n] of the FIR filter. Here M is the number of 
frequency points on the unit circle. Figure 11.6 illustrates the frequency sampling 
procedure, where M = 12. 

Once h[n] is obtained, we can write the frequency response as 


M-1 
H(w) = >> h{nje io" (11.13) 
n=0 
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Figure 11.6. Illustration of frequency sampling. 


and the values of H(q@) at frequencies œp = ink are simply (for k = 
0,1,..., M — 1), 
2ak 
H[k] =H (=) 
M 
M-1 
-27k 
= > hine i m”. (11.14) 
n=0 


The set of values {H [k]} are called the frequency samples of H (œ) and it corre- 
sponds to the M—point DFT of {h[n]}. 

By inverting Eq. (11.14), A[n] can be expressed in terms of the frequency sam- 
ples as 


M-1 
1 t 
h{n] = — > Hiklei i", n=0,1,...,M—1. (11.15) 


As can be seen from Eq. (11.15), it is the IDFT of the sequence {H[k]}. Now, 
we use this A[n] to find its z—transform and we have, 


M 


-1 
H(z) = > h[n]z” 
=0 


n 


M-1 M-1 
=y A H{klefar" |z” (11.16) 
7 
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By interchanging the order of the two summations in Eq. (11.16) and perform- 
ing the summation over the index n, we get 


M-1 1 M-1 et i 
H(z)= *_ HIK] È > (eiT) | 
k=0 n=0 
1-z MS AIK 
= < laa > (11.17) 


po Loe er 


Thus, the system function H (z) is characterized by the set of frequency samples 
{ H[k]} instead of {h[n]}. 
We can view this FIR filter realization as a cascade of two filters. That is, H(z) = 
A(z) H2(z). Here, Hj (z) is an all-zero filter with the system function 
zM 


Ay (z) = a (11.18) 


Its zeros are located at equally spaced points on the unit circle at zk = 
2ak 


elu, k=0,1,...,M—1. 
The second filter H2(z) with the system function 


M-1 


H{k 
F(z) = >) — a (11.19) 


k=0 1 — elm z7! 


consists of a parallel bank of M single-pole filters with resonant frequencies (pole 
locations), pk = dT, k=0,1,...,M—1. 

Note that the pole locations and zero locations are same on the unit circle and 
they occur at @ = a which are the frequencies at which the desired frequency 
response is specified. This cascade realization is illustrated in Fig. 11.7. The imple- 
mentation of the two sub-systems (H: (z) and H(z)) are clearly marked in the 
figure. 


11.2.4 Lattice Structure for FIR Systems 


This structure is used extensively in digital speech processing and in the imple- 
mentation of the adaptive filters because of its modular structure. Let us begin the 
development of lattice structure by considering a sequence of FIR filters with system 
functions 


Hm(z) = An(z), m=0,1,...,M — 1 (11.20) 
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Figure 11.7. Frequency-sampling realization of an FIR system. 


where, by definition Aj (z) is a polynomial of the form, 


m 
Am(2) =1+ >) amlkle*, m>1, (11.21) 
k=1 


and Ag(z) = 1. The unit sample response of the mth filter is Am[0] = 1 and 
hm[k] = am[k], k = 1,2,...,m. The subscript m on the polynomial Am (z) 
denotes the degree of the polynomial. For mathematical convenience, we define 
am[0] = 1. 

If x[n] is the input sequence to the filter Aj, (z) and y[n] is the output sequence, 
then 


y[n] = x[n] + >) amlklx[n — k]. (11.22) 
k=1 
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xin] yin] 


—ay[1] G) 


(b) 


Figure 11.8. Two direct-form structures of an FIR system (prediction filter). 


Two direct-form realizations of this FIR filter are shown in Fig. 11.8. The struc- 
tures shown in Fig. 11.8 are related to the topic of linear prediction,” where 


m 
&[n] = — $ amlk]x[n — k] (11.23) 
k=1 
is the one-step forward predicted value of x[n], using the m past inputs, and y[n] = 
x[n] — x[n], given by Eq. (11.22), represents the prediction error sequence. In this 
context, the top filter structure (Fig. 11.8(a)) is called the prediction error filter. 
Now, suppose that we have a filter of order m = 1. The output of such a filter is 


yin] = x[n] + a, [1]x[n — 1]. (11.24) 


This output can also be obtained from the first order or single-stage lattice filter, 
illustrated in Fig. 11.9, by exciting both of the inputs by x[n] and selecting the 
output from the top branch. Thus, the output is exactly Eq. (11.24), if we select 
Kı = a,[1]. The parameter K in the lattice filter is called the reflection coefficient. 

The different parameters of the above scheme are: 


foln] = goln] = x[n] 
filn] = foln] + Kigoln — 1] = x[n] + Kix[n — 1] (11.25) 
giin] = Kı foln] + goln — 1] = Kix[n] + x[n — 1] 


2. J. Makhoul, “Linear prediction: A tutorial review”, Proceedings of the IEEE, vol.63, No.5, pp.561-580, 1975. 
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Ale) =yir) 


gil] 


Jln] Slr) 


Ain] = yin) 


s[n] 


goln] gan- 1] gila] aln- 1] 


Figure 11.10. Two-stage lattice filter. 


Now, consider a FIR filter for which m = 2. The output for this case from the 
direct form structure (Eq. (11.22)) is 


y[n] = x[n] + az[1]x[n — 1] + az[2]x[n — 2]. (11.26) 


By cascading two single-stage lattice structures as shown in Fig. 11.10, it is pos- 
sible to obtain the same output as in Eq. (11.26). Indeed, the output from the first 
stage is, 


filan] = x[n] + Kiıx[n — 1], (11.27) 
gilan] = Kix[n] + x[n — 1]. (11.28) 


The output from the second stage is, 


hln] = film] + Kogil[n — 1], (11.29) 
gain] = Ka fila] + giln — 1). (11.30) 


By substituting for fi[n] and gı [n], we can show that 
hln] = x[n] + Kid. + K2)x[n — 1] + Kox[n — 2]. (11.31) 


This equation is identical to the output of the direct-form FIR filter as given by 
Eq. (11.26), if we equate the coefficients as 


a2[2] = K2, a[1] = Ki(1 + K2) (11.32) 
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Jlr filr] Jlr) Ju--l] = 
x[n] TA First Second = (M—1) Suit =yin] 
Stage Stage pæn Stage guib] 
goin] giln] gain] gy-21"] 
(a) 
Ja- ilar] Jal 


m-l] gn l7] 


Em iln = 1] 
(b) 


Figure 11.11. (M — 1)-stage lattice filter. 


or, equivalently, 


a[l] 
K = œ[2], Kı = CEPA (11.33) 
Thus, the reflection coefficients Kı and K> of the lattice filter can be obtained from 
the coefficients {@m[k]} of the direct-form realization. 

Continuing like this, by induction, we can show the equivalence between an 
mth order direct-form FIR filter and an m-order of m-stage lattice filter. The 
lattice filter is generally described by the following set of order-recursive equations 
(form = 1,2,..., M — 1), 


foln] = goln] = x[n], (11.34) 
fmin] = fm—iln] + Km8m—1[n — 1], (11.35) 
8mln] = Km fm-1[7] + 8&m-1[7 — 1]. (11.36) 


Then the output of the (M — 1)-stage lattice filter corresponds to the output of a 
(M — 1)-order FIR filter, that is, 


yla] = fm-ıln]. (11.37) 


Figure 11.11(a) shows a (M — 1)-stage lattice filter in block diagram and 
Fig. 11.11(b) shows one of the stages in the block diagram, where the computa- 
tions are specified by Eq. (11.35) and Eq. (11.36). 

As a consequence of the equivalence between an FIR filter and a lattice filter, the 
output fm[n] of an m—stage filter can be expressed as 


m 


faln] = > amiklxin — k], am[0]= 1 (11.38) 


k=0 
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Since Eq. (11.38) is a convolution sum, the z-transform relationship is 


Fin(z) = Am(z)X (z) (11.39) 


or 


Fin) _ Fin) 
X(z) Fok) 


Am(Z) = (11.40) 


The other output component from the lattice, namely, gm[n], can also be 
expressed in the form of a convolution sum as in Eq. (11.38), by choosing another 
set of coefficients {2m [k]}. 

From Eq. (11.28), we note that the filter coefficients for the lattice filter that 
produces fi[n] are {1, K1} = {1, ai[1]} while the coefficients for the filter with 
output gı[n] are {K1, 1} = {a,[1], 1}. That means they are in reverse order. If we 
consider the two-stage filter, with the output given by Eq. (11.30), we find that 
g2[n] can be expressed in the form, 


gln] = a2[2]x[n] + a2[1]x[n — 1] + x[n — 2], (11.41) 


where, the filter coefficients are {a@2[2], a2[1], 1} and the coefficients of the filter 
that produces the output f2[n] are {1, a2[1], a2[2]}. Here again, the filter coeffi- 
cients are in reverse order. From this development, for an m-stage lattice filter, we 
have 


8mln] = È Bmlklxin — k]. (11.42) 
k=0 


where the filter coefficients 
Bmlk] = amim — k], k=0,1,...,m (11.43) 


with fm[m] = 1. 

In the context of linear prediction, let us assume that the data x[n], x[n — 
1],...,x[n — m + 1] is used to linearly predict the signal value x[n — m] by 
the use of a linear filter with coefficients {— m [k]}. Then the predicted value is 


m-—l1 
ŝin —m] = — $ Bnlklx[n — k]. (11.44) 
k=0 


Since the data run in reverse order through the predictor, the prediction per- 
formed in Eq. (11.44) is called the backward prediction. In contrast, the FIR filter 
with system function Apm (z) is called a forward predictor. 
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In the z-transform domain, Eq. (11.42) becomes 


Gm (Zz) = Bm (z)X (2) (11.45) 
or, 
_ Gin(Z) 
Bm (z) = XÆ (11.46) 


where Bm(z) represents the system function of the FIR filter with coefficients 
{Bm[k]}. That is, 


Bm(z) = $ Bmlkle* (11.47) 
k=0 
Since Bm[n] = &m[m — k], Eq. (11.47) may be expressed as 
Bm (z) E S amin FA k]z™* 
k=0 
= > am (iz 
1=0 


=o > am[1]z" 
l=0 


=z" Am(z7) (11.48) 


This relationship implies that the zeros of the FIR filter with system function 
Bm(z) are simply the reciprocals of the zeros of Am (z). Hence Bm (z) is called the 
reciprocal or reverse polynomial of A,m (z). 

Now that we have established this interesting relationships between the direct- 
form FIR filter and the lattice structure, let us return to the recursive lattice equa- 
tions (11.34) through (11.36) and transfer them to the z-domain. Thus we have 
(for m= 1,2,...,M — 1), 


Fo(z) = Go(z) = X (z) (11.49) 
Fin(2) = Fn—1(2) + Km2~'Gm—1(2), (11.50) 
Gn (2) = KmFm—1(2) +z Gm—1 (2). (11.51) 
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If we divide each equation by X (z), we get the desired results in the form (for 
m= 1,2,...,M — 1), 


Ao(z) = Bo(z) = 1, (11.52) 
Am(z) = Am-1(z) + Kye BeA®, (11.53) 
Bm(Z) = KmAm—1(2) + z7 Bm-1(2). (11.54) 


In the matrix form, 
Am(Z) = 1 Km Am-1(Z) 
| Bm(z) | T | Km 1 | | z7! Bm-1(z) | ee) 


Conversion of lattice coefficients to direct-form filter coefficients: The direct form FIR 
filter coefficients {Gm [k ]} can be obtained from the lattice coefficients { K;} by using 


the following relations (for m = 1,2,..., M — 1): 


Ao(z) = Bo(z) = 1, (11.56) 
Am(Z) E Am-1(z) + Kae BA), (11.57) 
Bn(2) =z" Ap (2). (11.58) 


The solution is obtained recursively, beginning with m = 1. Thus we obtain a 
sequence of (M — 1) FIR filters, one for each value of m. 


Conversion of direct-form filter coefficients to lattice coefficients: Suppose that we are 
given the FIR filter coefficients for the direct-form realization or, equivalently, 


the polynomial Am(z), and we wish to determine the corresponding lattice fil- 
ter parameters {K;}. For the m-stage lattice, we immediately obtain the parameter 
Km = Om[m]. To obtain Km—1, we need the polynomials Am—1(z) since, in gen- 
eral, Km is obtained form the polynomial Am (z) form = M — 1, M —2,...,1. 
Consequently, we need to compute the polynomials A(z) starting from m = 
M — 1 and “stepping down” successively to m = 1. The desired recursive relation 
for the polynomials is easily determined from Eq. (11.53) and Eq. (11.54) as, 


Am(Z) = Am-1(Z) + Kmz`'Bm-1(2) 
= Am-1 z) + Km [Bm 2) = KmAm-1(2)]. (11.59) 


If we solve for Am—1(z), we get, 


Am (z) — KnBn (z) 


; =M-1,M-2,...,1. 11.60 


Am-1 (z) = 
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Thus, we compute all lower-degree polynomials A(z) beginning with A m—1 (2) 
and obtain the desired lattice coefficients from the relation Km = Gm[m]. We 
observe that the procedure works only if |Km| #1 form = 1,2,...,M — 1. 


Estimation of the Reflection coefficients: From the step-down recursive equation 


(Eq. (11.60)), it is easy to obtain a formula for recursively estimating the reflec- 
tion coefficients, Km, beginning with m = M — 1 and stepping down to m = 1. 
Form = M —1,M —2,...,1, we have 


Km =QGm[m],  Gm—1[0] = 1 (11.61) 
m k]— Km m k 
mae l o bi (11.62) 


a am[k] — am[m]amim — k] _ 
= f= , l<k<m-tl. (11.63) 


As mentioned above, the recursive equation in (11.62) breaks down if any lattice 
parameters |Km| = 1. If this occurs, it is indicative of the fact that the polyno- 
mial Aj—1(z) has a root on the unit circle. Such a root can be factored out from 
Am —1(z) and the iterative process in Eq. (11.62) is carried out for the reduced order 
system. 


11.3 Structure for IIR Systems 


We consider four different IIR system structures described by the difference equa- 
tion (Eq. (11.1)) or equivalently, by the system function (Eq. (11.2)). We are going 
to discuss the four main realization structures of the IIR systems, that are: 


e Direct-form structures, 

e Cascade-form structures, 

e Parallel-form structures, and 
e Lattice structures 


11.31 Direct-Form Structures 


The rational system function in Eq. (11.2) that characterizes an IIR system can be 
viewed as two systems in cascade, that is, 


A(z) = Ay(z) A(z), (11.64) 
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Figure 11.12. Direct Form | realization of IIR system. 


where Hj (z) is an all-zero system which consists of the zeros of H(z), and H2(z) 
is an all-pole system consisting of the poles of H(z). That is, 


M-1 M 
h@Q= > be => be, (11.65) 
k=0 k=0 


and 
1 


H(z) = 
1+ Dper ez 


(11.66) 


In Eq. (11.65), M — 1 in the summation is replaced with M for notational 
simplicity in the subsequent sections. Since H(z) is an FIR system, its direct-form 
realization was discussed already in the Section 11.2.1 (see Fig. 11.1). By attaching 
the second system in cascade with H(z), we obtain the Direct Form I realization of 
the IIR system and it is depicted in Fig. 11.12. This realization requires M +N +1 
multiplications, M + N additions, and M + N memory locations. 

If the all-pole filter (H2(z)) is placed before the all-zero filter (H1(z)), a more 
compact structure is obtained as explained below. 
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If we consider a 1st order system, Eq. (11.1), becomes 
yin] = —ayy[n — 1] + box[n] + byx[n — 1], (11.67) 


which is realized as in Fig. 11.13(a) (Direct Form I structure). This realization 
uses separate delays (memory) for both the input and output signal samples. As 
we explained here, this system can be considered as the cascade of two LTI systems. 
The first system is a non-recursive system (all-zero) described by 


v[n] = box[n] + bix[n — 1], (11.68) 
whereas the second system is a recursive (all-pole) system described by 
yla] = —ayy[n — 1] + ofn]. (11.69) 


It is known that interchanging the order of the cascaded LTI systems does not 
change the overall response of the system [8]. So, by interchanging/swapping the 
all-zero and all-pole systems, we obtain an alternative realization of the system in 
Eq. (11.67). The resulting structure of the system is shown in Fig. 11.13(b). From 
this figure, we obtain the following two difference equations 


w[n] = —a,w[n — 1] + x[n], (11.70) 
y[n] = bow[n] + biw[n — 1], (11.71) 


which provide an alternative algorithm for computing the output of the system 
described by Eq. (11.67). A close observation of Fig. 11.13(b) reveals that the 
two memory elements contain the same input w[n] and hence the same output 
w[n — 1]. Hence, these two memory elements are replaced by a singe unit as shown 
in Fig. 11.13(c). Compared to the Direct Form I structure, the new structure is more 
efficient in terms of the memory requirements. It is called the Direct Form II struc- 
ture. This idea can be extended to the general LTI system described in Eq. (11.1) 
and is shown in Fig. 11.14. This structure requires M + N + 1 multiplications, 
M+N additions, and maximum of {M, N} memory locations. Since this structure 
minimizes the number of memory units, it is also known as canonical structure. 


11.3.2 Cascade-Form Structure 


By assuming N > M, the IIR system in Eq. (11.2) can be factored into a cascade 
of second-order subsystems, such that H (z) can be expressed as, 


K 
He) =|] Ae) (11.72) 
k=1 
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(a) 


w[n- 1] w[n— 1] 


(b) 


(c) 


Figure 11.13. Steps in converting from the Direct Form | realization in (a) to the Direct 
Form II realization in (c). 


where K is the integer part of (N + 1)/2. Hg(z) has the general form 


bko + bez! + bkz? 


H; = 7 11. 
= + agyz—! + aggz-? one 


As in the case of FIR systems based on a cascade form realizations, the parameter 
bo can be distributed equally among the K filter sections. 

The coefficients {aki} and {bpi} in the second-order subsystems are real. This 
implies that in forming the subsystems or quadratic factors in Eq. (11.73), 


e We should group together a pair of complex-conjugate poles and a pair of 
complex-conjugate zeros. 
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Figure 11.14. Direct Form II realization of IIR system (M = N — 1). 


e The pairing of two complex-conjugate poles with a pair of complex-conjugate 
zeros or real-valued zeros to form the sub-systems can be done arbitrarily. 

e Any two real-valued zeros can be paired together to form a quadratic factor 
and, likewise, any two real-valued poles can be paired together to form the 
quadratic factor. 


This means that the roots of the numerator as well as the denominator of 
Eq. (11.73) may consist of either a pair of real roots or a pair of complex conjugate 
roots. 

If N > M, some of the subsystems have either by2 = 0, or Dg, = 0, or 
bk2 = bey = O for some k. Furthermore, if N is odd, one of the subsystems, 
say H(z), must have ag2 = 0, so that the sub-system is of first order. To preserve 
the modularity in the implementation of H(z), it is often preferable to use the 
basic second-order subsystems in the cascade structure and have some zero-valued 
coefficients in some of the sub-systems. 

The general form of the cascade structure is illustrated in Fig. 11.15. If we use 
the Direct Form II structure for each of the sub-systems, the computational algo- 
rithm for realizing the IIR system is described by the following set of equations 
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x[n]= x[n] yi] x[n] y[n]= xin] Ygaln]= xg[”] YXgin]= yin] 


(a) 


yan] =x] 


(b) 


Figure 11.15. Cascade structure of second-order system (a) and realization of each 
second-order section (b). 


(fork = 1,2,..., K): 


yolan] = x[n], (11.74) 
wln] = ~ai wrin — 1] — akzwg[n — 2] + yk- [7], (11.75) 
yk[n] = bkowrln] + Dep weln — 1] + beggin — 2], (11.76) 

yin] = yg[n]. (11.77) 


11.3.3 Parallel-Form Structure 


This structure of the IIR systems is developed based on the partial fraction expan- 
sion of H(z). By assuming N = M, the partial fraction expansion can be written as 


H(z) = c+ i (11.78) 


where { px} are the poles, {Ax} are the residues, and C = Pn, The structure implied 
by Eq. (11.78) is shown in Fig. 11.16. It consists of a parallel bank of single-pole 
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Figure 11.16. Parallel structure of IIR system. 


filters. In general, some of the poles of H (z) may be complex valued and the corre- 
sponding Ax’s are also complex valued. To avoid multiplications by complex num- 
bers, we can combine complex conjugate poles to form two-pole sub-systems. In 
addition, we can combine, in arbitrary manner, pairs of real-valued poles to form 
two-pole sub-systems. Each of these sub-systems has the form 


bro + baz! 
A(z) = : 11.79 
C) 1+ agiz7! + a227? l ) 
The overall function can now be expressed as 
K 
H(z) =C + >) Hil). (11.80) 


k=1 


The Direct Form II structure of the individual second-order sections which are the 
basic building blocks for H (z) is shown in Fig. 11.17. The parallel form realization 
of the IIR system is described by (for k = 1,2,..., K): 


wln] = ~ai win — 1] — agņ2wg[n — 2] + x[n], (11.81) 

ykln] = beowgln] + ber wxin — 1], (11.82) 
K 

yin] = Cx[n] + > ylin]. (11.83) 


k=1 
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ye] = xel] 


Figure 11.17. Structure of second-order section in a parallel IIR system realization. 


11.3.4 Lattice Structure for IIR Systems 


Let us begin with an all-pole system with the system function, 


1 1 


= ‘ 11.84 
145 ank Av@ meee 


H(z) = 


The direct form realization of this system is illustrated in Fig. 11.18. The corre- 
sponding difference equation for the IIR system is 


N 
yin] = — $ anlk]y[n — k] + x[n]. (11.85) 
k=1 


It is interesting to note that if we interchange the roles of input and output (i.e., 
interchange x[n] and y[n]), we obtain 


N 
x[n] = — > ay[k]x[n — k] + yin], (11.86) 
k=1 
or, equivalently, 
N 
yin] = x[n] + > an[k]x[n — k]. (11.87) 
k=1 


We note that this equation describes an FIR system having the system func- 
tion H(z) = Ay(z), while the system described by the difference equation in 
Eg. (11.85) represents an IIR system with the system function H(z) = nO 
That means, one system can be obtained from the other simply by interchanging 
the roles of input and output. 


234 Implementation of Digital Systems 


Figure 11.18. Direct form realization of an all-pole system. 


Based on this, we shall use the all-zero (FIR) lattice described in Section 11.2.4 
to obtain a lattice structure for the all-pole IIR system by interchanging the roles 
of input and output. First, we take the all-zero lattice filter illustrated in Fig. 11.11 
and then redefine the input as 


x[n] = fin, (11.88) 
and the output as 
yin] = foln]. (11.89) 


These are exactly the opposite of the definitions of the all-zero lattice filter. These 
definitions, dictate that the quantities { fm[n]} be computed in descending order 
lie., fla], fy—iln], ...]. This computations can be accomplished by rearrang- 
ing the recursive equation (Eq. (11.35)) and thus solving for fin—1[m] in terms of 
Fm{n], that is, 


fmin] = fmin] — Kmgm-1ln — 1], m=N,N—-1,...,1 (11.90) 


Equation (11.36) for gm[n] remains unchanged. The resulting set of equations are 
(form = N,N —1,..., 1): 


fni[n] = x[n], (11.91) 
fm—111] = fmin] — Kn8m-iln — 1], (11.92) 
Emln] = Km fm-iln] + 8m—iln — 1], (11.93) 
yla] = fola] = goln]. (11.94) 


The corresponding structure is shown in Fig. 11.19. 


11.4 Signal Flow Graphs and Transposed Structures 


A signal flow graph provides an alternative, but equivalent graphical representa- 
tion to a block diagram structure that we have been using to illustrate various 
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Input 


—— gain] 


pate — gin 


gyin] 


Figure 11.19. Lattice structure for an all-pole IIR system. 


system realizations. The basic elements of a flow graph are branches and nodes. A 
signal flow graph is basically a set of directed branches that connect at nodes. By 
definition, the signal out of a branch is equal to the branch gain (system func- 
tion) times the signal into the branch. Furthermore, the signal at a node of a 
flow graph is equal to the sum of the signals from all branches connecting to the 
node. 


11.4.1 Transposed Structure of IIR Systems 


To illustrate these basic notions, let us consider a two-pole and two-zero IIR sys- 
tem illustrated in block diagram form in Fig. 11.20(a). This block diagram can be 
converted to the signal flow graph as shown in Fig. 11.20(b). We note that the flow 
graph contains 5 nodes labeled 1 to 5. Two of the nodes (1,3) are summing nodes 
(i.e., they contain adding units) and the other three nodes representing branching 
points. Branch transmittances are indicated for the branches in the flow graph. A 
delay is indicated by the branch transmittance z~!. When the branch transmittance 
is unity, it is left unlabelled. The input to the system originates at a source node and 
the output signal is extracted at a sink node. 

One technique that is useful in deriving new structures for FIR and IIR systems 
stems from the transposition or flow-graph reversal theorem. This theorem states that 
if we reverse the directions of all branch transmittances and interchange the input 
and output in the flow graph, the system function remains unchanged. The result- 
ing structure is called a transposed structure or transposed form. 

For example, the transposition of the signal flow graph in Fig. 11.20(b) is illus- 
trated in Fig. 11.21(a). The corresponding block diagram realization of the trans- 
posed form is shown in Fig. 11.21(b). It is interesting to note that the transposition 
of the original flow graph resulted in branching nodes becoming adding nodes, and 
vice versa. 

Let us apply this theorem to a Direct Form II structure. First, we reverse all the 
signal flow directions in Fig. 11.14 with (M = N). Second, we change nodes into 
adders, adders into nodes, and finally, we interchange the input and the output. 
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x[n] 1 p] by 3 yin] 


Source node Sink node 


5 


Figure 11.20. Second-order filter structure (a) and its signal flow graph (b). 


The resulting transposed Direct Form II structure is shown in Fig. 11.22. This can 
be redrawn as in Fig. 11.23. which shows the input on the left and the output on 
the right. 

The transposed Direct Form II realization can be described by the set of differ- 
ence equations (for k = 1,2, ..., N — 1 and assuming M=N): 


y[n] = wi[n — 1] + box[n], (11.95) 
wen] = wkyil[n — 1] — agy[n] + bgx[n], (11.96) 
wy[n] = byx[n] — any[n]. (11.97) 


It is also clear from observing Fig. 11.23 that the above set of difference equations 
is equivalent to a single difference equation as follows 


N M 
yin] = — Xayin — k] + X` bex[n — k] (11.98) 
k=1 k=0 
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yn] e bo 3 x[n] 


Sink node Source node 


Figure 11.21. Signal flow graph (a) Its filter structure (b). 


Finally, we observe that the transposed Direct Form II structure require the same 
amount of computational complexity (multiplications, additions, and memory 
units) as the original Direct Form II structure. 


11.4.2 Transposed Structure of FIR Systems 


Although our discussion has been concerned with the general IIR systems, it is inter- 
esting to note that an FIR system obtained by setting a, = 0, k = 1,2,..., N in 
Eg. (11.98), also has a transposed direct form structure as illustrated in Fig. 11.24. 
This realization may be described by the set of difference equations (for k = 
M—-1,M-2,...,1): 


w gin] = b gx[n] (11.99) 
win] = wk+iln — 1] + bgx[n] (11.100) 


y[n] = wı[n — 1] + box[n] (11.101) 
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Os ® 


Figure 11.23. Transposed direct-form II structure. 
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x[n] 


TH- 


Figure 11.24. Transposed FIR structure. 


w2[n] w,[n] 


11.5 Concluding Remarks 


In this chapter, various schemes for the implementation of FIR and IIR systems 
were discussed in detail. Alternate structures were also discussed. They are: 


e The structures for FIR systems include: 
— Direct form structure 
— Cascade-form structure 
— Frequency sampling structure, and 
— Lattice structure 
e For IIR systems, the structures were: 
— Direct-form I structure 
— Direct-form II structure or Canonical structure 
— Parallel-form structure, and 
— Lattice structure. 


e Transposed structures for FIR as well as IIR systems. 


Exercises 


11.1. A second order digital filter is implemented using Direct Form II struc- 
ture as shown in Fig. P11.1. Here ao, a1, a2, b1, and b2 are the filter 
coefficients, x[n] is the input and y[n] is the output. 


(a) Determine the difference equation relating the input and the output 
and the frequency response of the filter. 

(b) Write down the pseudo-code for implementing the filter in Ques- 
tion (a). Comment on the implementation complexity. 
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Figure P11.1. Direct form II structure of 2”? order digital filter. 


11.2. The transfer function of a second order filter is given by: 


where the filter coefficients dg, a1, a2, b1, and bz are real numbers, and 


Ts is the sampling interval. The input and output signal of the filter are 


x[n] and y[n], respectively. 


(a) Write down the system function H(z) of the filter. Write down the 


(b 


wm 


WN 


difference equation that describes the operation of the filter. Draw 
the block diagram of the filter using Direct Form II. 

In the following, we will consider a simplified version of the filter 
for which a; = 0 and a2 = 0. Furthermore, the sampling interval 
is Ts = 2504s, bi = —2r cos(f) and b2 = r?°, where 0 < r < 1, 
and 0 < J < z. The impulse response of the simplified filter can 
be written as: 


sin([n + 1A) n 
sin(P) 


and is valid when n > O. Find the pair of values ag and £, for 
which the amplification of the filter at f = 1kHz is 1, and the 
amplification for frequencies 0 and 2kHz is the same (i.e., |H (0)| = 
|H (2kHz))|). 

Find the impulse response (h[n]) of the filter for 6 = 0. Examine 


h[n] = ao 


whether the filter is stable for all values of r in the given interval, 
when £ = 0. 
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(d) 


The signal x[n] is applied at the input of the filter. x[n] is the sam- 
pled version of the periodic analog signal x(t) given by: 


x(t) = dı cos(2z fot) + do cos(4z fot), 


where fo, dı, and d2 are constants. Find which frequency compo- 
nents are present in the output signal y[n] within the frequency 
range 0 — 2kHz, when fo = 9.5kHz. 


11.3. A digital filter (recursive) is implemented using Direct Form II as shown 


in Fig. P11.3. The filter coefficients a and b are constants, and the input 


and the output signals are denoted as x[n] and y[n], respectively. The 


sampling interval is denoted as T;. The symbol z~! in the figure repre- 


sents a unit sample delay. 


(a) 


(b) 


x[n] 


Figure P11.3. 


Draw the block diagram of the filter implemented in Direct Form I. 
Write down the difference equation that describes the operation of 
the filter. Find the system function H(z) and the transfer function 
H(f) expressed as functions of a, b, and Ts. 

For the rest of the problem, we assume that x[n] is a real digital 
signal, and that a and b are given by 


- 2am - 2am 


b=2 2nm ITN +e IN 
= £c0s | ——_] =e e x 
N 


where m and N are integer constants. The output signal y[n] is 
complex, i.e., y[n] = yrln] + jyrln]. 

Find the complex impulse response h[n] of the filter (use the 
complex expression for b). 
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11.4. 


11.5. 
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(c) The Discrete Fourier transform (DFT) can be realized as a filter 
bank. The m'" coefficient of the DFT (calculated at digital fre- 
quency fm = F where 0 < m < N — 1) is the output of a 
filter with an impulse responde hm[n]. Show the first N values of 
h[n] have a simple relation to Am[n]. 


This problem considers a filter, which approximates an ideal low-pass 
filter with an impulse response (unit sample response) h[n] and a transfer 
function H(f) = |H(f)|e/?, where O(f) = arg(H(f)). The 
non-zero values of the impulse response are given in the table below. 
The impulse response is equal to zero (h[n] = 0) for all other time 
instances, n. 


n | ı |3| SF 8 9). u |13| 15 
hin] | -73 | 3 | — ig | i | 3 | 5 | — ig | 37 | — TE 


The width of the filter’s pass-band is approximately ie where fg = 
$ = or The two constants fs and Ts are the sampling frequency and 
sampling interval, respectively. Within its pass-band, the filter has no 


Zeros. 


(a) Find H(f) at the three frequencies 0, fe and f,. Explain why 
the phase, arg(H (f)) of the transfer function of the filter is lin- 


ear below f = fe and sketch arg(H(f)) in this region. 


The operation of a digital filter can be described by the following differ- 


ence equation: 
y[n] = aox[n] + azx[n — 2] + biy[n — 1], 


where x[n] is the input signal to the filter and y[m] is its output signal. 

ao, 42, and by are real constants. The sampling interval for the digital 

signal is Ty. 

(a) Draw the block diagram of the filter implemented in Direct Form I 
and in Direct Form II. Then show that the impulse response of the 


filter is: 
0 for n <0 
_ Jao for n=0 
nls agb for n=1 


aob} + abt? for n >2. 


(b) Write down the condition under which the filter is stable. Write 
down the transfer function H (f) of the filter. 
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In the following question, the sampling interval is chosen to be 
s = 500us. The following digital signal is applied at the input of 
the filter: 


x[n] = sina finT;), 


where fı = 3.5kHz. The filter coefficients ag, a2, and bı are set to 
be ao = a = by = } for the next question. 
(c) Give the placement and the amplitudes of the components of y[n] 
in the amplitude spectrum for frequencies in the range 0 to 2kHz. 
11.6. In this problem, we will consider a series of identical filters whose inputs 
and outputs are cascaded as shown in Fig. P11.6(a), and the digital input 
and output signals are x[n] and y[n], respectively. 


x[n] Filter 
Section 1 |y 


x[n] 


xin] 


(b) 


Figure P11.6. 


The input signal to the i!” filter is denoted as x;[n] and its output 
signal, y;[n]. The input signal to the i!” stage x;[n] is the output from 
the (i —1)!" stage yj-1[n], i.e., xi[n] = y;-1[n]. Figure P11.6(b) shows 
the block diagram of a single section (i'” section) from the filter, where 
dg, 41, and az are real constants, and Ts is the sampling interval. 


(a) For the first question, the cascade filter consists of N identical sec- 
tions, where N is a positive integer number. Give an expression for 
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the impulse response h; [n] and the transfer function Hj (f) ofa sin- 
gle section expressed through the filter coefficients ag, a1, a2, and 
Ts. Express the combined impulse response h[n] through h;[n] and 
the combined transfer function H(f) through Hj(f). 

Here, the number of sections N is chosen to be 2. Write down the 
impulse response h[n] of the total filter expressed as a function of 
dg, 41, and a2. Draw a block diagram of the (total) filter realized in 
Direct Form I. 


(b 


wm 


~ 
a 
VN 


The signal x[n] at the input of the filter comes from an analog to 
digital converter (ADC). At the input of the ADC, the following 
periodic signal is applied: 


x(t) = do cos(2z fot) + dı cos(2z fit), 


where do, d1, fo, and fi are real constants. The conversion to the 
digital signal can be assumed to be exact (without quantization 
errors). The sampling frequency is 1.5kHz, and fo = 9.5kHz, and 
fi = 2.3kHz. Give the frequencies of those frequency components 
that are present in the frequency range from —1.5kHz to 3kHz. 


11.7. In this problem, we will consider a digital low-pass filter described by 


the following difference equation: 


N-1 
yin] = ayxin — N] + $ [agxtn — q] + aqx[n — 2N + q1], 
q=0 


where N is a positive integer number, and ag and ay are real num- 
bers. The amplitude of the transfer function of the filter is shown in 
Fig. P11.7. Here, fọ = n where Ts is the sampling interval of the 
signal x[n]. 


Amplification (dB) 


Flfa 


Figure P11.7. 
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11.9. 


(a) 


(b) 


(a) 


(b) 


and output, respectively of the system. In the figure, the symbol z7 


(a) 


Explain why the impulse response of the filter is symmetric around 
n = N and draw a block diagram of the filter realized in Direct 
Form I. Sketch the phase of the transfer function of the filter for 
|f| < 0.2 fg, when N = 32. 

Using the given low-pass filter as a basis, design a new complex fil- 
ter (with complex coefficients), which lets the frequency compo- 
nents from 0.3 fẹ to 0.7 fg pass with an unaltered amplitude and 
suppresses the components at negative frequencies. Write down the 
impulse response of the complex filter expressed as a function of fg, 
N, ag, and ay. Sketch the amplitude of the transfer function of the 
filter in the frequency range from —2 fg to 2 fg in the same way as 
shown in Fig. P11.7. 


. Ina “talking dictionary” system, the “lattice” filter shown in Fig. P11.8 is 
used to generate a synthetic speech signal y[n] from an input excitation 
x[n] created from the acoustic template of the word to be spoken. 


Derive the transfer function of the filter and write a pseudo-code 
programme for implementing the filter directly (at the expense of 2 
multiply operations per sample). 


yin] 


Figure P11.8. 


The direct implementation of the lattice filter in Fig. P11.8 requires 
2 multiplication operations per sample. Since multiplication is dif- 
ficult to implement in hardware and is a time-consuming opera- 
tion, a creative engineer attempts to implement the filter using just 
1 multiply operation per sample. Can this be done? How would you 
propose to do this? Rewrite the programme if necessary. 


Consider the block diagram representation of a causal linear time invari- 
ant (LTI) system shown in Fig. P11.9. Here x[n] and y[n] are the input 


1 


denotes a unit sample delay and v[n] is an intermediate variable. 


Derive the transfer function H(z) for the given system and draw 
the direct form-I implementation structure of the system. 


246 


11.10. 


Implementation of Digital Systems 


Figure P11.9. 


(b) Reconfigure the system implementation structure in the form of a 
standard canonic (Direct Form-II) structure and compare its imple- 
mentation complexity to that of the Direct Form I implementation 
scheme. 


(c 


wa 


Sketch the pole-zero distribution of the system in the Z-domain 
and comment on its stability. 

(d) Derive an expression for the impulse response h[n] of the system 
and plot the first five samples (i.e., the numerical values of h[n] for 
n = 0, 1, 2,3, and 4) as a function ofn. 


Consider the block schematic of a linear time-invariant (LTI) digital 
system as shown in Fig. P11.10. Here x[n] and y[n] are the input and 
output, respectively of the system. h[n] is the impulse response of the 


x[n] yin] 


Figure P11.10. 


system. 


The system function H (z) = ze is given by, 


1 — 0.36272 
1+0.1z—! —0.72z-2’ 


H(z) = 


1 


where z~* represents a unit sample delay and X (z) and Y (z) are the 


z-transforms of the input and output, respectively. 

(a) Draw the “transposed Direct Form II” structure for the given sys- 
tem. 

(b) Determine whether the system is stable or not. 
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(c) Assume that the overall system (H (z)) is realized by cascading two 
first-order sub-systems (H(z) and H(z)). Draw the respective 
Direct Form I structures for Hı (z) and H(z). 

(d) Derive the impulse response h[n] of the overall system. 


11.11. Consider the block diagram representation of the cascade of three causal 
first-order linear time-invariant (LTI) systems shown in Fig. P11.11. 


x[n] 


Figure P11.11. 


The system functions for the sub-systems are: 


2+0.1z7! 3 +0.2z7! 


H ————— H SS 
= og O= 793-7 


1 
MOSTI 


(a) Determine the transfer function, H (z), of the overall system as a 
ratio of two polynomials in z~!. 

(b) Determine the difference equation characterizing the overall system. 

(c) Sketch the pole-zero distribution of H (z) in the z-domain and com- 
ment on its stability. 

(d) Develop a parallel form realization of the overall system with each 
parallel section containing a single pole. 

(e) Derive the impulse response h[n] of the overall system in a closed 
form. 


11.12. Consider the block diagram representation of a second-order filter 
shown in Fig. P11.12. Here x[n] and y[n] are the input and output, 
respectively of the filter. The parameters a, 8, and y are scalars. The 
symbol z~! denotes unit sample delay. 


(a) Derive the transfer function H (z) for the given filter and draw the 
direct form-I implementation structure of the filter. 

(b) Reconfigure the filter in the form of a standard second-order 
canonic (Direct Form-I]) structure and compare its implementation 
complexity to that of the Direct Form I implementation scheme. 

(c) Sketch the pole-zero distribution of the filter in the Z-domain and 
comment on its stability (Assume a = 0.5, 6 = 2, and y = 1). 

(d) Derive the impulse response h[n] of the filter. 


11.13. Consider the block diagram representation of a second-order filter 
shown in Fig. P11.13. Here x[n] and y[n] are the input and output, 
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Figure P11.12. 


respectively of the filter. The system function H(z) (z-transform of 
h[n]) of the filter is given by, 


12277 +z? 
1 — 0.75z-! + 0.125272" 


H(z) = 


The symbol z~! in H(z) denotes a unit sample delay. 


x[n] yin] 


Figure P11.13. 


(a) Determine the difference equation that relates the output y[n] to 
the input x[n]. Draw the Direct Form I implementation structure 
of the filter. 

(b) Reconfigure the filter in the form of a standard second-order 
canonic (Direct Form II) structure and compare its implementation 
complexity to the Direct Form I implementation scheme. 


~ 
O 
Ci 


The system function H(z) for the given second order filter can be 
considered as the cascade of two first order recursive systems, H4 (z) 
and H>(z), respectively. From H(z), identify the first order recur- 
sive systems H(z) and H2(z) and draw the cascade form structure 
for H(z). Make sure to use Direct Form II structures for H4 (z) and 
A(z). 

(d) Asan alternative to factoring the numerator and denominator poly- 
nomials in H(z), this rational function can be written as a partial 
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11.14. 


11.15. 


fraction expansion resulting in the parallel form realization of the 
second order system. Derive and draw the parallel form structure of 
H(z) with first order sub-sections. 

(e) By making appropriate assumptions (initial rest), derive the expres- 
sion for the impulse response (h[n]) of the filter. 


Consider the second-order filter depicted by the block diagram in 
Fig. P11.14. Here x[n] and y[n] are the input and output, respectively 
of the filter and a and az are the filter coefficients. The symbol zl in 
the figure denotes a unit sample delay. The transfer function and impulse 
response of the filter are denoted by H(z) and h[n], respectively. The 


sampling interval T, of the digital signal is assumed to be normalized to 


unity. 


Figure P11.14. 


(a) Derive the expression for the transfer function H(z) of the filter. 
Comment on the type of the filter (i.e., low-pass, high-pass, all-pass, 
band-pass, or band-stop etc.) based on its frequency response. 

(b) Reconfigure the filter in the form of a standard second-order 
canonic (Direct Form II) structure and compare its implementation 
complexity to the realization given in Fig. P11.14. 

In the following, we will assume that a) = -43 and a2 = a 

(c) Sketch the pole-zero distribution of the filter in the Z—domain and 
comment on the stability of the filter. 

(d) By making appropriate assumptions (initial rest), write out the 
expressions (computation not required) for the first six values of 
the impulse response of the filter (i.e., h[n] for n =0,1,...,5). 


A digital filter (H (z)) is constructed by cascading two simple filters with 


transfer functions Hı (z) = 5(1 — z7?) and Ao(z) = ee 
-47 78 
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(a 


wa 


Derive the transfer function H(z) of the resulting filter and draw 
its pole-zero diagram. 

(b) Comment on the stability of the filter H (z) 

(c) Draw the Direct Form II realization of the filter H (z) 

(d) Compute the first six values of the impulse response (h[n]) of the 
filter. 


11.16. A digital filter is described by the following difference equation 


1 
yal =o elie 


where y[n] is the output and x[n] is the input to the system. 


(a) Derive the transfer function H(z) of the resulting filter and draw 
its pole-zero diagram. 
(b) Draw the Direct Form II realization of the system and comment on 


its stability. 
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Chapter 12 


Discrete Fourier Transform 


In many practical signal processing applications, Discrete Fourier Transform (DFT) 
is the most important transform method used to perform Fourier analysis. Mathe- 
matically, DFT converts a finite input sequence of equally spaced samples of a signal 
into a sequence (same length) of equally spaced samples of the DTFT, which is a 
complex valued function of frequency. The interval at which the DTFT is sampled 
is the reciprocal of the length of the input sequence. An inverse DFT (IDFT) is 
a Fourier series, using the DT FT samples as coefficients of complex sinusoids at 
the corresponding DTFT frequencies. It has the same sample values as the original 
input sequence. The DFT, therefore, provides the frequency domain representa- 
tion of the original input sequence. If the original sequence spans all the non-zero 
values of a signal, its DTFT is continuous (and periodic), and the DFT provides 
discrete samples of one cycle of the signal. If the original sequence is one cycle of a 
periodic signal, the DFT provides all the non-zero values of one DTFT cycle. 

So far in this book, we have discussed three different frequency-domain repre- 
sentations for time-domain signals: 

e Continuous-Time Fourier Series (CTFS; Chapter 3): 

To determine the spectra of continuous-time periodic signals. These signals 


result in discrete-frequency spectra. 
e Continuous-Time Fourier Transform (CTFT; Chapter 4): To determine the 
spectra of continuous-time non-periodic signals. These signals result in 
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continuous-frequency spectra. The CTFS can be considered as a special case 
of CTFT for periodic signals. 

e Discrete-Time Fourier Transform (DTFT; Chapter 9): To determine the 
spectra of discrete-time non-periodic (and periodic) signals. These signals 


result in continuous-frequency spectra which are periodic. 

In this chapter, the objective is the computation of the Fourier spectra of finite- 
duration sampled signals. This arises from the fact that the signal measured in any 
practical application will be finite in duration. We are expected to use this finite- 
duration record of the signal to make inferences on the spectrum of the original 
signal (e.g., speech or bio-medical signals), which may be infinite in duration (in 
reality). Therefore, it is of interest to know how the finite data length of the mea- 
sured record affects the computed spectrum. 

The following points will be discussed in detail in this chapter. 


e How does computing the spectrum at discrete values of frequency (i.e., sam- 
pling in frequency domain) affect the signal in time domain? 

e Frequency-domain representation of periodic discrete-time signals. 

e Frequency-domain representation of finite-duration discrete-time signals. 

e The relevance of periodicity in time domain to computation of the spectra 
of discrete-time finite-duration signals. 

e What precautions should be taken to guarantee that the computed spectrum 
is close to the actual spectrum? 


12.1 Practical Aspects of Spectrum Computation 


There are mainly two limitations associated with practical computation of 
spectra. 


e The signal is recorded for a finite duration in time. This effect can be exam- 
ined using the method of windows. 

e The spectrum is computed for discrete values of the frequency. This is equiv- 
alent to sampling the spectrum in frequency domain. 


12.1.1 Spectra of Windowed Signals 


Let xa(t) be a continuous-time signal of very large duration. Further, let x[n] 
denote the samples of this signal, taken at the rate of fy = t samples/second 
(i.e., Ts is the sampling period). Thus, we have 


x[n] =x g(nT;), for —co<n<o. (12.1) 
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The measured record of samples (data) in a particular experiment is given by 
y[n] = x[n] for n=0,1,...,N—1. (12.2) 


In other words, the signal is observed for a finite duration of time from t = 0 to 
t = [N — 1]T,. Therefore, we can express the measured signal as 


y[n] = x[n]w[n] = xa (nTs)w[n] (12.3) 


where w[n] is a window function defined as 


a= 1 for n =0,1,...,N—1 12.4) 
0 otherwise. 
Thus, we find that 
_ |xin] for n=0,1,...,N—1 
y= Fe otherwise. (12.5) 
Using Eq. (12.3), we can express the spectrum (DTFT) of y[n] as 
7 T X 0.5 S 
v=xfhowh=f xwwF-wdu 020 
J—0.5 


where © denotes ‘circular convolution’ (also known as ‘periodic convolution’), 


W(f) is the DTET of w[n] and is given by 


o0 7 N-1 z 
W(f) = > wjin]je i?” = > wfin]e iS" 
n=—0o n=0 
—j2a fN E : r 
ERN opoo (SIM) ayy 
l—e Jaf sin(z f) 


Clearly, we will get Y(f) = X(f) only if W(f) = o(f), which will happen 
only when N > oo. Thus, we find that the finite data length causes the computed 
spectrum, Y (f), to be different from the actual spectrum, X (f). 


12.1.2 Sampling in Frequency-Domain: Derivation of DFT 


Here, we will derive the expression for the DFT of a sampled signal. 
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The spectrum, Y ( f), of the measured data is given by’ 


N-1 : 
r= S ne e Ox 7 <10 (12.8) 
n=0 


Even though the frequency, f, varies continuously in the range [0, 1.0], in practice, 
we evaluate the spectrum, Y (f), only at discrete values of the frequency, given by 


[o, Af, 2af, =, W-DAF, N-DAF} 029) 
where A f = +- 
Define Yy = Y (kA f) = Y (4). Then, we can obtain from Eq. (12.8) 
N-1 
—j2a(£)n 
Ye = yine” A, (12.10) 
n=0 


=r N —jon E : szaj : ; 
pan = eÍ NN), we see that Yp is periodic with period N 


(i.e., Yk+N = Yk). 
Let/ € {0,1,2,..., N — 1}, i.e., l is an integer in the range 0, 1,--- , N — 1. 
Then, consider the following’: 


N-1 _ Waira F (4) : 
In & —j2r( 4 )n On & 
>, Y,e127 N! — y[n]e J N el2t N! 


k=0 k=0 Ln=0 
—1 N-1 ‘ 
= y[n] 5 el?" villa] 
n=0 k=0 


1. In Eq. (12.8), for the sake of convenience, we use the period defined by 0 < f < 1.0 instead of —0.5 < 
f < 0.5 for our analysis. 


2. Note the following. 


ela pli- _ y if l=n 
k=0 
oN 
_ el?" yn] 
= —___— =0 if lAn. 
j= el?" Nli- 
N-1 " 
> eax) — NOll — n]. 
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N-1 
= >) yin] [Noll — nl] = Nyt] 
n=0 
1 = k 
=> == Ypel?” N” 12.11 
ylnl = = D Yee (12.11) 
k=0 
for n = 0,1,...,N — 1. Since e~/?” wn is also periodic in n with period N 
(i.e, e 27 WIRtN] — e Jn K”), we see that y[n] is periodic with period N (i.e., 
y[n + N] = y[n]). We have the following remarks. 


Sampling of the spectrum causes the time-domain signal to be periodic (i.e., y[n+ 
N] = y[n]). The period is given by the inverse of the sampling period used for 
sampling the spectrum (i.e., a7): In other words, the DFT treats the finite- 


duration signal {y[0], y[1], y[2],--- , yLN — 1]} as one period of a periodic 
signal with period N. 

But the original measured signal record (i.e, y[n| forn = 0,1,...,N — 
1) is not periodic! That is, discretizing the frequency axis (ie, f = 
0,1/N, 2/N,..., [N — 1]/N) has the effect of making the input signal y[n] 
appear as though it is a periodic discrete-time signal with period N. 

The above observed property is the dual of the sampling theorem?’ we studied 


in Chapter 7. We saw in Chapter 7 that sampling in time domain results in 
periodicity in frequency domain. The derivation above shows that sampling in 
frequency domain results in periodicity in time domain. 

Equations (12.10) and (12.11) define the DFT pair of equations. Equation 
(12.10) defines the forward DFT, and Eq. (12.11) defines the inverse DFT 
(IDFT). 

For a finite-duration signal, y[n], of length N samples, its DFT is obtained by 
evaluating its DTFT (defined in Chapter 9) at frequency resolution 1/N . Thatis, 


- k 
y= P a ny =F ($) (12.12) 


where Y ( f) denotes the DTFT of y[n]. The resulting DFT spectrum, Yx, is 
periodic with period N. 


If you wish to explore the meaning of aliasing in time domain caused by sampling in frequency domain, use 
Af = 1/M in Eq. (12.9). The frequency grid is then given by {0, Af, 2Af, ey (M— AF, (M — 
1)A f} and M will be the period in time and frequency domains. Then, aliasing will occur in the time 
domain if M < N. For example, let N = 5 and M = 3. Then, one period of the aliased signal (i.e., left-side 
of Eq. (12.11)) will be {y[0] + y[3], y[1] + y[4], y[2]}. 
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Since there is a close connection between DFT and periodic discrete-time signals, 
we shall next explore the frequency-domain representation of discrete-time periodic 
signals. 


12.2 Discrete Fourier Series (DFS) 


In Chapter 3, we studied Fourier series as a frequency-domain representation of 
continuous-time periodic signals. In this section, we explore a similar representation 
for discrete-time periodic signals. 

Let x[n] for n = 0,1,..., N, be one period of a discrete-time periodic signal 
with period N. Then, using Eqs. (12.10) and (12.11), we can obtain the DFT 
equations 


N-1 
Xe = do afne A", (12.13) 
n=0 
1 i= yk 
x[n] = N » Xel” N”, (12.14) 
k=0 


fork = 0,1,2,...,N — l andn = 0,1,2,...,N — 1. We have the following 


remarks. 


e We have 
x[n + N] = x[n] and Xk+N = Xk. (12.15) 


e The periodicity in time domain imposed by the IDFT computation in 
Eq. (12.14) is naturally satisfied by x[n], since we chose x[n] to be a periodic 
signal with period N. 

e Equation (12.14) is the Fourier series representation of the periodic sig- 
nal x[n] using N discrete-time complex sinusoids at frequencies 0, 1/N, 
2/N, ---,(N—1)/N. Therefore, Eq. (12.13) is known as the forward DFS 
and Eg. (12.14) as the inverse DFS. 

© Because 27" = eN”, we need only N complex sinusoids with fre- 
quencies k/N, k = 0,1,2,...,N — 1, in the Fourier series representation 
(Eq. (12.14)). 

© We call Eqs. (12.13) and (12.14) as DFS equations when the original x[n] is 
periodic. We call these as DFT equations when the original x[n] is not periodic 
(aperiodic). 
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12.2.1 Derivation of DFS 


Let xa (t) be a continuous-time periodic signal with period T, = 1/fp, where fp is 
its fundamental frequency. Therefore, using Fourier series, we can express Xq(t) as 


CO 
xat) = 5 X pel? Sot (12.16) 


k=—0o 


where X are the Fourier series coefficients. It is easy to see that we can construct 
a discrete-time periodic signal, x[n], with period N from x(t) by sampling x, (t) 
with sampling rate fs = N fp. That is, 

1 1 


x[n] = Xa (nT; ) with Ts = T = NF, 


where T, is the sampling period. Using Eq. (12.16), we can express x[n] as 


(12.17) 


oo 
x[n] = xa(nTs) = $, Xe! Mons 


k=—0o 


= k 
= » Xel N”, (12.18) 
k=—0o 
since fpTs = 1/N. Express k ask = IN + m, where l ranges from —oo to +00 
and m = 0,1,2,..., N — 1. Then, 


ae: 3 IN ; : ; 
el? Hn = ei2t tn = ei2ning jax gn = elt HN 


Using these, we can express the right side of Eq. (12.18) as 


co N-I1 


[0,0] 
we wy k ~ «> 1N+m 
S terta SF tner, 


k=—oo l=—oo m=0 


N-1 lee) 
sed z m 
=F | È Ban er 


m=0 Ll=—co 


1 N-1 
= lye (12.19) 
m=0 


where 


CO 
Xm=N >) Xinam. (12.20) 


l=—0o 
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Substituting Eq. (12.19) in Eq. (12.18), we get 
. k 
x[n] = — 5 Xel TN”, (12.21) 


forn = 0,1,2,..., N — 1. Further, we have 


N-1 N-1 N-1 i 
> x[nJe7/2" n" = > È BS xer] eminin, 
N 


n=0 n=0 k=0 

I N-1 N-1 

cage X,Y eft WH, 
N k=0 n=0 
l N-1 

=H Xz [No[k —1]] = X17, 

k=0 
N-1 i 
> X= > x[nJe~/27 nv", (12.22) 

n=0 


fork = 0,1,..., N — 1. Equation (12.22) is the forward DFS and Fq. (12.21) 
is the inverse DFS. Comparing Eqs. (12.22) and (12.21) with Eqs. (12.13) and 
(12.14), respectively, we again see that the Fourier series representation of a discrete- 
time periodic signal is same as the DFT of one period of this signal. 


12.2.2 Periodicity and Circular Shift of DFT 


Recall that DFT makes the finite-length signal x[n] of N samples to appear periodic 
with period N. That is, 


x[n + mN] = x[n] for any integer m (12.23) 


withn = 0, 1,2,..., N — 1. This is illustrated in Figure 12.1 (a) which shows the 
periodically repeated version of the signal x[n] for N = 6. Figure 12.1 (b) illustrates 
another way of showing the periodic signal x[n]. Each period is arranged with N 
equally spaced points on a circle, in the counter clockwise direction. Therefore, 
the different periods of the signal, wrap around this circle, as illustrated for three 
periods in Fig. 12.1. 

Taking a closer look at Fig. 12.1 will reveal that circularly shifting a N -point signal 
{x[0], x[1], +- , x[N — 1]} és equivalent to linearly shifting its periodic version. For 
example, let x[n] = x[n — 2]. Then, using Fig. 12.1(a), one period of x[n] for 
n =0,1,..., N — 1 is given by {x[—2], x[—1], x[0], --- , x[3]} which is same 
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(b) 


Figure 12.1. Illustration of the time-domain periodicity caused by DFT for a N-point signal 
record x[n] with N = 6. (a) linear representation and (b) circular representation. 


as {x[4], x[5], x[0], --- , x[3]}. This can also be obtained from Figure 12.1(b) by 
starting from the index ‘4 [n — 2 + N] with n = 0, N = 6) and completing one 
circle in the counterclockwise direction. 


12.3 Properties of DFT and DFS 


We shall now discuss some properties of DFT and DFS. Since DFT and DFS are 


essentially the same, we shall only refer to DFT in this section. 
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Let x[n] and y[n] be two discrete-time signals of length N with DFTs Xx and 
Yx, respectively. That is, 


N-1 N-1 
š k . k 
X= S oae Je", Xe =D yine Pw" 
n=0 n=0 
, Nol oe , Nz! ae 
x[n] = 7 5 Xel” N", y[n] = p Y,e/°* wn 
k=0 k=0 


forn = 0,1,2,...,N—landk =0,1,2,...,N—1. 


12.31 Linearity 


Let p[n] = ax[n] + fy[n] where a and £ are two scalars. Then, we can easily 
show that 


Pk =aXk + BY x. (12.24) 


Thus, DFT is a linear transform. 


12.3.2 Time Shifting 


Let p[n] = x[n — no] where no € {0,1,..., N — 1}. Then, we get (with m = 
n — no) 


N-1 N—-1—no 


P= > x[n — nole~/2* kn = » x[m]e £ [m+no] 
n=0 m=—no 
N-1-—no 
= e7 i2T kno > x[m]e 7}? kim 
m=—no 
= ei yny (12.25) 


: —jax tm: ae . , : 
since x[m]e~/?* N" is periodic with period N. Thus, as in earlier chapters, the only 
effect of shifting a signal in time domain is a linear phase change in the frequency 
domain (no change in magnitude spectrum). 


12.3.3 Time Reversal 


Let p[n] = x[—n]. Then, we get (with m = N — n) 


N-1 N-1 
j k . k 
P, = By x[—n]e—72" 7" — = x[N —n]e/27 N" 


n=0 n=0 


Properties of DFT and DFS 


= k N k 
= > sine ae = > x[m]e/2™ w” 
m=1 m=1 


= X_x. 


12.3.4 Frequency Shifting 


Let p[n] = elt w"x[n] with / e {0,1,..., N — 1}. Then, we get 


N-1 N-1 


‘ 1 : k . k-l 
P, = >. el N"x[n]e—/2" N” = > x[n]e n” 
n=0 n=0 
= Xķk-ı. 


12.3:5 Circular Convolution 


Let p[n] denote the ‘circular convolution of x[n] and y[n] given by 


N-1 
pin] = x[n] © yin] = > x[lyin — 1. 
1=0 


Then, we get (with m =n — I) 


N-1PTN-1 
P= > > x[ly[n — J ean 
n=0 L/1=0 
N-1 N-1-l 
x] > y[m]e7J27 Kim] 
1=0 m=—l 


= 


N-1-1 

3 k . k 

= xe?" N! > y[m]e—/?7v™ 
1=0 m=—l 


= X Yy: 
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(12.26) 


(12.27) 


(12.28) 


(12.29) 


Thus, in the case of DFT, circular convolution in time domain results in multi- 


plication in frequency domain. This is unlike in CTFT and DTFT where linear 


convolution‘ in time domain results in multiplication in frequency domain. 


4. Difference between linear and circular convolutions: Let a[n] and b[n] be N-point data sequences which 
are zero for n outside {0, 1,..., N — 1}. The linear convolution between a[n] and b[n] is given by 


N-1 
piln] = a[n] ® bin] = ba alllbin - 1] 


1=0 
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Similarly, we can show that multiplication in time domain results in circular 
convolution of DFTs. That is, 


q[n] = x[n]y[n] (12.30) 
N-1 
XkOY;I 1 
N N = 


12.3.6 Real Symmetric Signals 
If x[n] is real, i.e., x[n] = x*[n], then 
Xt = Xk = XN. (12.32) 


If x[n] is real and even-symmetric, i.e., x[n] = x[—n] = x*[n], then the DFT 
Xj will be purely real: 


Xk = X-k = XË = Xyk. (12.33) 


If x[n] is real and odd-symmetric, i.e., x[n] = —x[—n] = x*[n], then the DFT 
Xj will be purely imaginary: 


Xk = —X -k = -Xý = —Xn-x. (12.34) 


12.4 DFT of Sinusoidal Signals 


Consider the continuous-time signal x, (t) obtained by adding two complex sinu- 
soids with amplitudes {A1, A2} and frequencies { f1, f2} as 


X(t) = Aei 4 Agel, (12.35) 


Let us sample this signal at rate fs samples/second such that there is no aliasing in 
the frequency domain. This can be ensured by choosing’ fs > max{2| fi |, 2| fol}. 


where a[n] = 0 and b[n] = O ifn g {0,1,..., N — 1}. The circular convolution between a[n] and b[n] 
is given by 
N-1 
pln] = a[n] © bin] = $ afl |b[n — 1) 
1=0 
where G@[n] and b[n] are obtained by periodically extending a[n] and b[n], respectively. In writing 
Eq. (12.28), it is assumed that x[n] and y[n] are periodic because of DFT. 


5. For complex signals, the sampling frequency for no aliasing can be smaller than twice the maximum fre- 
quency in the signal. For example, if fi = —50 Hz and f2 = 120 Hz, then it is easy to verify that any 
sampling rate fs > 170 samples/second is sufficient to guarantee no aliasing. This is because the spectra of 
complex signals may not be symmetric. 
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Then, we get the sampled signal as (with sampling period T; = 7) 


x[n] = xa (NTs) = Aret? i" 4 Azet?7 fon (12.36) 


where fi = f and h = L., Let us examine the DFT of this signal x[n] for a 
N -sample record. 


N-1 
X; = > [Ajen ae Azez Ar] eit Hn 
n= 


= a N-1 7, 
Ay S elt (An ke + A> 5 eri)", (12.37) 
n=0 n=0 


Consider the following cases. 


Case 1: The frequencies fı and fz are such that 


bh bh 
a? and NTF (12.38) 


where kı and k2 belong to {0, 1,..., N — 1}. In this case, we get the DFT from 
Eq. (12.37) as 


Xg = NAjO[k — kı] + N A2ôf[k — k2] (12.39) 
This implies that 
NA, if k=k 


X= 4NA if k=k (12.40) 
0 otherwise. 


Case 2: The frequencies fı and f2 do not satisfy Eq. (12.38) for any kı, k2 in 
{0,1,..., N — 1}. In this case, we get the DFT from Eq. (12.37) as 


pion (NAi-k) E (Nfr-k) 
+ A2 


{<= eo" (A-4) 
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jntw—1(fi-4) S GG E N fi) 
dis (zN = fi) 
ZIN- n(A- ) sin (x(k - fy) 
an (zN = Ay) 


= Aje 


+A2¢e (12.41) 


Case 3: The frequency fı satisfies Eq. (12.38) and f2 does not satisfy Eq. (12.38). 
In this case, we get the DFT from Eq. (12.37) as 


= NAjo[k — kı] 


jxN-1)(fi—4) sin (x(k — N fa) 


mee sia (atk IN — f)) l 


(12.42) 


Based on the above, we can infer the following. 


e The DFT will result in the expected spectrum of two discrete lines at f| and 
fo only if the frequencies of the sinusoids, (f1, f2), and the choice of the 
sampling frequency, (fs), and data length, N, satisfy the condition given by 
Eq. (12.38). 

e This condition ensures that the normalized frequencies of the sinusoids cor- 
respond to two of the frequencies (k/N) at which the DFT is evaluated. 

e Since Eq. (12.38) implies that N = uh = Bf 2, this is also equivalent to 
saying that the data length N contains an integer number of periods of the 
signal xq(t). This is because Eq. (12.38) is equivalent to the following: 


NT; = kT, = knh (12.43) 


where T; = 1/fı and T2 = 1/f2 are the periods of the two sinusoids, and 
NT; is the time duration over which the signal is observed and sampled. 


12.5 Concluding Remarks 


We conclude this chapter with the following remarks. 


e DFT isa tool for computing the spectrum of signals in practical applications. 
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e DFT computes the spectrum at discrete frequencies, which are equally 
spaced, based on finite data records. The spacing between the frequencies 
are given by 1/N where N is the length of the data record. 

e The sampling of the spectrum by DFT causes the signal to appear periodic 
in time domain with period N, even though the original signal record is not 
periodic. 

e DFT fora signal record {x[n]} of N samples is the same as the DFS of a peri- 
odic signal which is a periodic extension of the signal record {x[n]}. In other 
words, the DFT treats the finite-duration signal {x[0], x[1], x[2],--- ,x[N— 
1]} as one period of a periodic signal with period N. 

e Because of the periodicity in time domain caused by DFT, multiplication of 
the DFTs of two finite-length sequences becomes equivalent to their circular 
convolution in time domain. Similarly, multiplication of the data sequences 
in time domain becomes equivalent to circular convolution of their DFTs. 

e The DFT of a sinusoidal signal will indicate the actual frequencies of the 
sinusoids only if the normalized frequencies of the sinusoids fall exactly on 
the frequencies at which the DFT is evaluated. 


Exercises 


12.1. Let us consider the use of DFT to compute the autocorrelation of the 
complex-valued sequence x[n], that is, 


N-m-1 
1 
rxx[m] = W > x*[n]x[n +m], m>0 
n=0 


Suppose the size M of the DFT is much smaller than that of the data 
length N. Specifically, assume that N = KM. 


(a) Determine the steps needed to section x[n] and compute r;,[m] 
for —(M/2)+1 < m < (M/2)-— 1, by using 4K M—point DFTs 
and one M—point IDFT. 

(b) Now, consider the following three sequences x[n], x2[n], and 
x3[n], each of duration M. Let the sequence x;[n] and x2[n] have 
arbitrary values in the range 0 < n < (M/2) — 1, but be zero for 
(M/2) <n < M —1. the sequence x3[n] is defined as 


xila], 0 < (M/2)-1 


x3[n] = aes (M/2)<n<M-1 
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12.2. 


12.3. 


12.4. 


12.5. 


12.6. 


12.7. 
12.8. 
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Determine a simple relationship among the M—point DFTs X,[k], 
X2[k] and X3[k]. 

(c) By using the result in part (b), show how the computation of the 
DFTs in part (a) can be reduced in number from 4K to 2K. 


(a) Find the 89 point DFT of x[n] = e? 8”, 


(b) Find the 89 point DFT of x[n] = e)?” an, 
(c) The 128 point DFT of e/27 SI" hasa magnitude of 


sin | (As — fi) 128] 
sin |x (s -A)| 


Find |X[k]| for fi = 733 and 2. 
(d) An analog signal xa (t) = e/7 10 is digitized at 500 Hz sampling 


rate to generate the discrete-time signal x[n]. Use N— point DFT 


|X[A]| = 


to sketch the magnitude spectrum for N = 4, 6, and 8. 
A sampling rate of f; Hz is used to generate the discrete-time signal 
x[n] from the analog signal xg(t) = e~ ug (t), where ualt) denoting 
the unit step function. Find the spectra of x[n] using the N— point 
DFT. What happens when N is large? 
(a) The 6-point DFT X[0], X[1],..., X[5] of x[n] is given by 


5 
X[k] = Dixie", k=0,1,...,5 


Ignoring the range for k, show that X[k] is periodic and has a period 
of 6. 

(b) The 7-point DFT of x[n] is 1, 2, 3, 4, 5, 6, 7. Find the 7-point 
DFT of y[n] = x[n]e}? 7". 

(a) Consider the 6-point DFT X[0], X[1],..., X[5] of a real signal 
x[n]. Relate X[5] to X[1] and X[4] to X[2]. Show that X[0] and 
X [3] are real. 

(b) The 6-point DFT X[0], X[1], ..., X[5] ofa real signal x[n] satisfy 
X[5] = X*[1], X[4] = X*[2], X[0] = real and X[3] = real. 
Sketch the DFT spectrum. 

(a) Sketch the 6-point DFT spectrum of x[n] = 2 cos (2x z), 

(b) Find the 9-point DFT of x[n] = 2 cos(27 0.2n) + 3 sin(2m 0.3n). 

Find the DFT of x[n], which is given by 4, 2, -2, 0, 2, -2. 

In this problem, let X[k] be the N-point DFT (Discrete Fourier 

Transform) of the real-valued N-point sequence x[n], 0 < n < N-1. 
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12.9. 


We define a 2N-point sequence y[n] as 


(a) 


(b) 


(c) 


x [z] for n even 


v= y forn odd. 


Express the 2N-point DFT Y[k] of y[n] in terms of X[k] (Hint: 
Use the appropriate “twiddle factor” to derive the DFT. For exam- 
ple, the twiddle factor Wy is defined as Wy = eT F) 

In the following, it is assumed that the N-point DFT X[k] of 
x[n] is bandlimited. That is, X[k] = 0 for kọ < k < N — kọ, 
where kg < N is a positive integer constant. We insert (L — 1)N 


more zeros in the middle of X[k] to obtain the following L N-point 
DFT: 


X[k] for 0< k< kọ- 1 
X'[k]= 40 for ko < k < LN — kọ 
X[k +N- LN] for LN-kot+1<k<LN-1, 


where L is a positive integer constant. 
Show that Lx’[Ln] = x[n], 0< n < N- 1, where x'[n] is the 
IDFT (inverse DFT) of X’[k] (Hint: Use the appropriate “twiddle 
factor” to derive the DFT and IDFT). 

In the following, it is assumed that N = 7 and x[n] = 1 for 
n=0,1,...,N — 1. The z-transform X (z) of x[n] is sampled 
at 5 points on the unit circle to obtain the corresponding 5 DFT 
coefficients X’[k], k =0,1,...,4. This is obtained by substitut- 
ing z = eS in the expression for X (z). 

Determine the IDFT x’[n] of X’[k], compare it with the original 
sequence x[n] and comment on the results. 


Consider the continuous-time signal, xg(t) = 2cos(80at) + 


2 sin(90zt). We want to use discrete Fourier transform (DFT) for exam- 


ining the spectrum of this signal. 


(a) 


(b) 


For this signal, what is the minimum possible sampling frequency 
that results in alias-free spectrum? 

Derive the relation between sampling frequency and DFT-size N so 
that the DFT spectrum is free from spectral leakage (i.e., the DFT 
spectrum contains exactly four non-zero values corresponding to 
the frequencies present in xa(t)). (Note: You may use the results 
available for complex sinusoids to derive this.) 
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(c) If the sampling frequency is chosen as 91 samples/second, what is 
the minimum possible value for N so that the DFT spectrum is free 
from spectral leakage? 

(d) Assume that the signal xg(t) is sampled at the rate of 100 sam- 
ples/second. Consider the following two cases. In Case 1, you are 
given 50 samples. In Case 2, you are given 555 samples. Will there 
be spectral leakage if we compute DFT in these two cases? In which 
of these cases you prefer to use a non-rectangular window while 
computing the DFT spectrum? Justify your answer. 


DOT: 10.1561/9781680839791.ch13 


Chapter 13 


Fast Fourier Transform 


Fast Fourier transforms (FFT) are widely used algorithms in digital signal process- 
ing for applications in several fields including almost all engineering disciplines, 
science, and mathematics. The basic ideas for the FFT algorithms were proposed 
by Cooley and Tukey in 1965 [13]. In 1994, Gilbert Strang described the FFT as 
the most important numerical algorithm of our lifetime.' In an article that was pub- 
lished in 2000 in the IEEE magazine on Computing in Science and Engineering, 
FFT algorithm was listed as one of the top 10 Algorithms of the 20th century.’ 

In the last chapter, the DFT and IDFT algorithms were derived. It can be seen 
that for finding the DFT of a sequence of length N, it requires N? multiplications, 
which is quite high as N increases. Fast Fourier transform (FFT) is an algorithm 
that computes the DFT of a sequence, or its IDFT with as low as x log, N mul- 
tiplications. This means that the FFT algorithm(s) are much faster than the DFT 
algorithm, especially when the length of the input sequence N increases. 

In this chapter, the fundamental steps in the development of a Radix-2 FFT 
algorithm is described in detail. 


1. G.Strang, “Wavelets”, American Scientist, vol. 82, no. 3, 1994, pp. 250-255. JSTOR, www.jstor. 
org/stable/29775194 


2. J. Dongarra and F Sullivan, “Guest Editors Introduction to the top 10 algorithms”, IEEE Magazine on 
Computing in Science & Engineering. vol. 2, No. 1, pp. 22-23, 2000. 
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13.1 Fast Fourier Transform (FFT) 


The FFT is a computationally efficient approach to compute the DFT spectrum. 
For example, the computation of a N-point DFT (ie., Xg, k = 0, 1,2,..., N—1) 
will require N? complex multiplications (and N(N — 1) complex additions). This 
can be quite costly for large values of N. 

The principle behind FFT can be explained using a 15-point DFT example 
shown later in this section. Since the computational complexity of DFT is propor- 
tional to the square of the number of samples, the basic principle behind FFT is 
to transform the problem of computing a N-point DFT into that of computing 
DFTs of smaller sizes (“Divide -and-conquer’ approach), and using these smaller- 
sized DFTs to obtain the required N-point DFT. 


13.1.1 Direct Computation of DFT 


Given a sequence of data {x[n]} of length N, its N-point DFT sequence {X[k]} 
(complex valued) is calculated according to, 


N-1 
X[k] = >) xin]Wy", O<k<N-1 (13.1) 
n=0 
where 
Wy =e iw (13.2) 
is the twiddle factor. 
In general, the sequence {x[m]} is also assumed to be complex valued. The IDFT 
becomes, 
l N-1 
xl = 5 > XikIWy™, O<n<N-1. (13.3) 
k=0 


Since the DFT and IDFT involves basically the same type of computations, the 
method to efficiently compute DFT also applies to IDFT as well. 

It can be seen that for the N point DFT, it requires N? complex multiplica- 
tions (4N? real multiplications) and N 2_N complex additions (2N(2N — 1) = 
4N? —2N teal additions). This makes the direct computation of DFT highly inef- 
ficient especially when N is large. By exploiting the symmetry en A= -W5 ) 
and periodicity (WEEN = Wk) properties of the phase factor Wy, an efficient 
algorithm (known collectively as FFT) can be derived. 
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13.1.2 Divide-and-Conquer Approach 


This approach is based on the decomposition of an N-point DFT into successively 
smaller DFTs. Assuming that N is not a prime number, it is possible to factor N as 
the product of two integers as, 


N=LM (13.4) 


The assumption that N is not a prime number is not restrictive, since we can pad 
any sequence with zeros to ensure a factorization as above. 

The sequence {x[n]},0 < n < N -—1, can be stored either in a one-dimensional 
array indexed by n or as a two-dimensional array indexed by the row index, / (0 < 
l < L — 1) and column index, m (0 < m < M — 1) as shown in the following 
Tables 13.1 and 13.2. 

Thus, the sequence {x[n]} can be stored in a rectangular array in the following 
two different ways, each of which depends on the mapping of index n to the indices 
[l,m]. 

If we select the mapping, 


n=Ml+m, (13.5) 


it leads to the arrangement in which the first row consists of the first M elements of 
x[n], the second row consists of the next M elements of x[n], and so on, as shown 
in the Table 13.3 (row-wise). 


Table 13.1. Storing of the data in one- 


dimensional array. 


n 0 1 2 tee N-1 


x x[0] x0] xR] --- x[N-1] 


1\m 0 1 2 ced M-1 

0 x[0, 0] x[0, 1] x(0,2] --» xf[0,M—1] 
1 x[1, 0] x{1, 1] x, x[l, M — 1] 
2 x[2, 0] x[2, 1] x[2,2] =  x[2,M—1] 


LA), x[L-1,0 x[L-1,1] 26s +. x[L-1,M-1] 
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Table 13.3. Row-wise arrangements for the data arrays. 


1\m 0 1 as M-1 

0 x[0] x[1]  x[M—1] 
1 x[M] x[M +1] -xM -1] 
2 x(2M) x[2M +1] s 2BM=1] 
L—-1 x[[L-1]M] x[[L-1]M +1] --- x[{LM—1] 


Table 13.4. Column-wise arrangements for the data arrays. 


l\m 0 1 eee M-1 

0 x[0] x[L] vee x[[M — 1]L] 
x[1] x[L + 1] x[[M — 1]L +1] 

2 x[2] x[L + 2] x[[M — 1]L +2] 

L-1 x[L-1] x[2L-1] x[LM — 1] 


On the other hand, the mapping 
n=l+mL (13.6) 


stores the first L elements of x[n] in the first column, the next L elements in the 
second column, and so on, as shown in the Table 13.4 (column-wise): 

A similar arrangement can be used to store the computed DFT values as well. 
In particular, the mapping is from the index k to a pair of indices [p, q], where 
0<p<L-—land0 <q < M —1. If we select the mapping k = Mp + q, the 
DFT (X[k]) is stored row-wise and if the mapping is k = gL + p, then the DFT 
is stored column-wise. 

Now, suppose that x[n] is mapped into the rectangular array x[/, m] and X[k] 
is mapped into the corresponding rectangular array X[p, q]. Then the DFT can be 
expressed as a double sum over the elements of the rectangular array multiplied by 
the corresponding phase vectors. To be specific, let us adopt a column-wise mapping 
for x[n] and row-wise mapping for the DFT. Then, 


M-1L-1 


tipal= > > aia, ee (13.7) 
m=0 1=0 
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Nmp _ mqL __ mq _ mq Mpl _ pl = pl 
However, Wy © = 1, Wọ = Wit = Wu „and Wy = Wym = WL- 


With these simplifications, the above equation can be expressed as 


L-1 M-1 
Xip] = >) {ws z x[, mwg || wP. (13.8) 


1=0 m=0 


This expression involves the computation of DFTs of length M and L. To see 
this, let us subdivide the computations into three steps: 


e First, we compute the M-point DFTs 


M-1 
Fll,g]= $ xil, mW, O<q<M-1, (13.9) 


m=0 


for each of the rows l = 0, 1,..., L — 1. 
e Second, compute a new rectangular array G[/, q] defined as 


Gil, q] = Wy FIL, q] (13.10) 


forO<1<L—land0O<q<M-1. 
e Finally, compute the L-point DFTs 


L-1 
X[p.q1= >. GU, q]W?, (13.11) 
1=0 


for each column q = 0,1,..., M — 1, of the array G[J, q]. 


By looking at the procedure, one may feel that the outlined procedure is more 
complex than the direct computation of the DFT. However, by evaluating the 
computational complexity of Eq. (13.8), this doubt can be cleared. The first step 
involves the computation of L DFTs, each of M points (LM? complex multi- 
plications and LM(M — 1) complex additions). The second step requires LM 
complex multiplications. The final step in the computation requires ML? com- 
plex multiplications and ML(L — 1) complex additions. So, there are a total of 
N(M + L + 1) complex multiplications and N(M + L — 2) complex additions, 
where N = ML. The number of complex multiplications has been reduced from 
N? to N(M + L +1) and the number of complex additions has been reduced 
from N(N — 1) to N(M+L — 2). For example, suppose N = 1000 and we select 
L = 2 and M = 500. Then instead of having to perform 10° complex multipli- 
cations, this approach reduces to 503, 000 complex multiplications (a reduction of 
50%). The number of additions is also reduced by a factor of 2. 
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When N is a highly composite number, that is, N can be factored into a product 
of prime numbers of the form 


N=rjro...y (13.12) 


then the decomposition above can be repeated (v — 1) more times. This procedure 
results in smaller DFTs, which, in turn, leads to a more efficient computational 
algorithm. 


Example 1: Given the input x[n] of length 15, find the 15 point DFT of the 
sequence. 

The given input sequence is x[0], x[1],..., x[14]. N = 15. Since N = 5x3 = 
15, we select L = 5 and M = 3 so that the 15 point sequence is stored column-wise 
as follows: 


Row 1: x[0, 0] = x[0] x[0, 1] =x[5] x[0,2] = x[10] 
Row 2: x[1,0] = x[1] x[1,1] =x[6] x[1,2] = x[11] 
Row 3: x[2, 0] = x[2] x[2, 1] = x[7] x[2,2] = x[12] 
Row 4: x[3,0] = x[3] x[3,1] = x[8] x[3,2] = x[13] 
Row 5: x[4, 0] = x[4] x[4, 1] = x[9] x[4,2] = x[14] 


Now, we compute the 3-point DFTs for each of the five rows giving us the fol- 
lowing 5 x 3 array: 


F[0,0] F[0,1] F[Ọ,2] 
F[1,0] F[1,1] F{[,2] 
F[2,0] F[2,1] F[2,2] 
F[3,0] F[3,1] F[3,2] 
F[4,0] F[4,1] F[4,2] 


The next step is to multiply each of the terms F[/,q] by the phase factors 
wi = wid, O<l<4and0 < q < 2. This results in the following 5 x 3 
array: 


Column1 Column 2 Column 3 
G[0, 0] G([0, 1] G[0, 2] 
G[1, 0] G[1, 1] G[1, 2] 
G[2, 0] G[2, 1] G[2, 2] 
G[3, 0] G[3, 1] G[3, 2] 
G[4, 0] G[4, 1] G[4, 2] 


Fast Fourier Transform (FFT) 275 


Wis 
— M3] 
— M5] 
x[0] = — 418] 
x[ 1] =- 

i i — yN] 
«12 g — x114) 
x[3] a 
x{4] 2 


Figure 13.1. Computation of N = 15-point DFT by means of 3-point and 5-point DFTs. 


The final step is to compute the 5-point DFTs for each of the three columns. 
This gives the desired values of the DFT in the form 


X[0,0] = X[0] X[0,1] = X[1] X[0,2] = X[2] 
X[1,0] = X[3] X[1, 1] = X[4] X[1,2] = X[5] 
X[2,0] = X[6] X[2, 1] = X[7] X[2,2] = X[8] 
X[3,0] = X[9] X[3, 1] = X[10] X[3, 2] = X[11] 
X[4, 0] = X[12] X[4, 1] = X[13] X[4, 2] = X[14] 


Figure 13.1 illustrates the computational steps. It may be noted that the input 
sequence is in shuffled order, whereas the output sequence is in normal order. 
Input sequence order: x[0], x[5], x[10], x[1], x[6], x[11], x[2], x[7], x[12], 
x[3], x[8], x[13], x[4], x[9], x[14]. 


To summarize, the steps involved in the algorithm are: 


Algorithm 1: 


e Store the signal column-wise. 

e Compute the M-point DFT of each row. 

e Multiply the resulting array by the phase factors wa, 
e Compute the L-point DFT of each column. 

© Read the resulting array row-wise. 


Algorithm 2: 


e Store the signal row-wise. 

e Compute the L-point DFT of each column. 

e Multiply the resulting array by the phase factors WẸ”. 
e Compute the M-point DFT of each row. 

© Read the resulting array column-wise. 
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13.2 Radix-2 FFT Algorithm 


In the previous sub-section, we have shown that the N-point DFT can be efficiently 
computed by factoring N as the product of prime numbers r1, r2, ..., Fy. One of 
the special case is when r1 = r2 =... = ry = r, so that N = r”. In sucha case, 
the DFTs are of the same size (r) and the computation of the N-point DFT has a 
regular pattern. Here, the number r is called the radix of the FFT algorithm. When 
r = 2, the resulting FFT algorithm is termed the radix-2 FFT algorithm. 

Let us consider the computation of the N = 2” point DFT by divide-and- 
conquer approach. We select M = N/2 and L = 2. This selection results in 
splitting the N point data sequence into two N /2 point data sequences f)[n] and 
f2[n], corresponding to the even-numbered and odd-numbered samples of x[n], 
respectively as 


fiin] = x[2n], n=O Zod (13.13) 


flin] = x[2n + 1]. (13.14) 


Here fi[n] and f[n] are obtained by decimating x[n] by a factor of 2 and hence 
the resulting FFT algorithm is called the decimation-in-time algorithm. 

Now, the N-point DFT can be expressed in terms of the DFTs of the decimated 
sequences as follows: 


N-1 
X[k] = S aW, k=0,1,...,N—1, 

n=0 

= X xW + So xw, 
n even n odd 
N/2-1 N/2-1 

= >) xQmywy + X xm + yw" (13.15) 
m=0 m=0 


But W? = Wy 2. With this substitution, the above Eq. becomes 


N/2-1 N/2-1 
X[k] = > film|Wri + Wi > falm] Wiis 
m=0 m=0 
= Fy[k]+ Wi Folk], k=0,1,...,N—1. (13.16) 


where Fi [k] and F>[k] are the N/2-point DFTs of f[n] and f2[n], respectively. 
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Figure 13.2. First step in the decimation-in-time algorithm. 


Since Fi [k] and F2[k] are periodic with period N/2, we have F\[k + N/2] = 
F\[k] and Fa[k + N/2] = Fa[k]. In addition, the factor Wit’? = —Wwk. 
Hence, Eq. (13.16) can be expressed as (for k = 0,1,..., x — 1), 


X[k] = Filk] + Wh Folkd, (13.17) 


X |k + >| = F\[k] — W$ Folk]. (13.18) 


It can be seen that to compute the N-point DFT of x[n], by this process, 
the number of complex multiplications has been reduced to 2(N/2)? + N/2 = 
N?/2 + N/2 compared to N? (for direct computation); a reduction of a factor of 
x2 for large N. 

Figure 13.2 illustrates the first step in the decimation-in-time algorithm. 

Having performed the decimation-in-time once, we can repeat the process for 
each of the sequences f[n] and fo[n]. Thus f\[n] would result in two N /4 point 
sequences. The number of complex multiplications to compute F;[k] and F2[k] 
is now reduced to N?/4 + N/2. To compute X[k] using Fi[k] and F2[k], we 
require another N /2 complex multiplications. Consequently, the number of mul- 
tiplications is reduced again by a factor of 2 to N?/4 + N. 

This process can be repeated until the resulting sequences are reduced to one- 
point sequences. For N = 2”, this decimation can be performed v = log, N times. 
Thus the total number of complex multiplications reduces to (N/2) log, N. The 
number of complex additions is N log, N. A comparison of the computational 
complexity for the direct computation of the DFT versus the FFT algorithm for 
different N is provided in Table 13.5. 
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Table 13.5. Comparison of the computational complexity for 


the direct computation of the DFT versus the FFT algorithm. 
N N? (DFT) x log, N (FFT) Improvement factor 


2-point 
xB]—| 2point > DFTs 
P DFT 


Figure 13.3. Three stages in the computation of an N = 8-point DFT. 


4 16 4 4.0 
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x[5] DFT Combine 


For illustration, Fig. 13.3 depicts the computation of an N = 8-point DFT. 
This is achieved in three stages, beginning with 4 two-point DFTs, then 2 four- 
point DFTs and finally, one 8-point DFT. The combination of the smaller DFTs 
to form the larger DFT is illustrated in Fig. 13.4. 

Observe that the basic computation performed at every stage, is to take two com- 
plex numbers, say the pair [a, b], multiply b with Wj, and then add and subtract 
the product from a to form the two new complex numbers (A, B). This basic com- 
putation is called the butterfly (Fig. 13.5) structure because the flow-graph resembles 
a butterfly. 

Each butterfly involves one complex multiplication and two complex addi- 
tions. For N = 2”, there are N/2 butterflies per stage of the computation pro- 
cess and log, N stages, which results in (N /2) log, N complex multiplications and 
N log, N complex additions. 

An important observation is concerned with the order of the input data 
sequence after it is decimated (v — 1) times. Consider the case where N = 8. 
After the first decimation, we get the sequence order as x [0], x[2], x[4], x[6], 
x[1], x[3], x[5], x[7]. After the second decimation, the order becomes x[O], 
x[4], x[2], x[6], x[1], x[5], x[3], x[7]. This shuffling of the input data sequence 
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Figure 13.4. Eight-point decimation-in-time FFT algorithm. 
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Figure 13.5. Basic butterfly computation in the decimation-in-time FFT algorithm. 


has a well-defined order as can be seen from Fig. 13.6 and Table 13.6. By express- 
ing the data index n in binary form, we note that the order of the decimated data 
sequence is easily obtained by reading the binary representation in the reverse order. 

Another important radix-2 FFT algorithm, called the decimation-in-frequency 
algorithm, is obtained by using the divide-and-conquer approach with the choice 
of M = 2 and L = N/2. This choice implies a column-wise storage of the input 
data sequence [5]. 


§ Radix-4 FFT Algorithms: When the number of data points (N) in the DFT is a power 
of 4 (ie, N = 4"), we can of course always use a radix-2 algorithm for the computation. 
However, for this case it is more efficient to employ a radix-4 FFT algorithm. 
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Figure 13.6. Shuffling of the data and bit reversal. 


Table 13.6. Shuffling of the data and bit reversal. 


Original order [n] nnno ninon2 nonin2 Shuffled order 


0 000 000 000 0 
1 001 010 100 4 
2 010 100 010 2 
3 011 110 110 6 
4 100 001 001 1 
5 101 011 101 5 
6 110 101 011 3 
7 111 111 111 7 


13.2.1 Applications of FFT Algorithms 


Basically, the FFT algorithm is used as an efficient means to compute the DFT and 
IDFT of sequences. Other applications include linear filtering, correlation, and 
spectrum analysis [5]. 
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13.3 Concluding Remarks 


We conclude this chapter with the following remarks. 
e The fast Fourier transform is a computationally efficient means of computing 


DFT, requiring only X log, N multiplications, compared with N required 
for direct computation. 


Exercises 


13.1. To efficiently compute the 256 point FFT of two real signas x[n] 
and y[n], we form w[n] = x[n] + jy[n] and compute W[k]. Can 
X([3], X[253], Y[3] and Y[253] be found from W[3] and W[253]? 

13.2. To compute the 64-point FFT of x[0], ..., x[63], we divide x[n] into 
four sequences: 


xo[n] = x[0], x[4],... 
xila] = x[1], x[5],... 
x[n] = x[2], x[6],... 
x3[n] = x[3], x[7],... 


Can the 64-point FFT of X[k] be found from combining the 16-point 
FFTs of these sequences? 

13.3. Dual Tone Frequency Modulation (DTMEF) is used in touch-tone keypad. 
Pressing ‘1’ gives two real sinusoids at 697 and 1209 Hz. Pressing other 
keys give two sinusoids at other frequencies. Consider a simpler two key 
single tone system. ‘1’ gives a 506 Hz and ‘2’ gives a 1215 Hz tone. We 
need to detect the keys or tones every 0.01 seconds or so. We need to 
sample at 8 kHz as the telephone speech has a bandwidth of up to about 
4 kHz. 


Key ‘2’ wrongly pressed 
Speech Key ‘2’ Pressed Key ‘1’ Pressed while talking 


ivy | | | il | | | | | | | | | | | | / Wh A J \; / w , 


| | | | | | | | | 


Se pe 


One frame = 79 samples = 0.01 s 


Figure P13.3. 
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(a) If DFT is to be used in this case, what should the DFT size be? 

(b) Suppose a 79 point DFT is used in Question (a) above. Sketch the 
DFT spectrum for the signal shown in Fig. P13.3 below and indicate 
whether the keys will be detected. 


DOT: 10.1561/9781680839791.ch14 


Chapter 14 


Design of Digital Filters 


A digital filter is a LTI discrete-time system that is realized using finite precision 
arithmetic. The design of digital filters involves three basic and independent steps: 

e The specification of the desired properties of the system. 

e The approximation of these specifications using a causal discrete-time system. 

e The realization of these specifications using finite precision arithmetic. 

In the filter design process, we determine the coefficients of a causal FIR or IIR 
filter that closely approximates the desired frequency response specifications. The 
issue of which type of filter to design, FIR or IIR, depends on the application as 
well as the specifications of the desired frequency response. In practice, FIR filters 
are employed in problems where there is a requirement of linear phase characteris- 
tics within the pass-band of the filter. If such requirements are not specified, either 
an IIR or FIR filter may be employed. However, as a general rule, an IIR filter 
has lower side-lobes in the stop-band than the FIR filter having the same num- 
ber of parameters. For this reason, if some phase distortion is either tolerable or 
unimportant, an IIR filter is preferable, primarily because of its fewer parameters 
for implementation. Further it require less memory and has lower computational 
complexity. 
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14.1 Characteristics of Practical Frequency-Selective 
Filters 


Figure 14.1 illustrates the desired frequency response characteristics of different 
types of filters. Ideal filters are non-causal and hence physically unrealizable for real- 
time signal processing applications. Causality implies that the frequency response 
characteristics H (œ) of the filter cannot be zero, except at a finite set of points in the 
frequency range. In addition, H (œ) cannot have an infinitely sharp cut-off from 
pass-band to stop-band, that is H (œ) cannot drop from unity to zero abruptly. 
In this chapter, we limit our discussions to the design of the class of LTI systems 
specified by the difference equation 


N M-1 
yin] = — Do agyln — k] + Ý dyxtn — k], (14.1) 
k=1 k=0 
Hy) 
1 
Low-pass 
=F —O, 0 Op T @ 
High-pass 
™ o 
Band-stop 
i minat -@ D l 2 m @ 
Band-pass 
soi x @ 
1 
All-pass 
=E 0 Tt w 


Figure 14.1. Ideal frequency response characteristics of different types of filters. 
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Figure 14.2. Magnitude characteristics of physically realizable filters. 


which are causal and physically realizable. Such systems have a frequency response 


M-1 — jak 
Dao bee! 


Le ae a 


H(o) = (14.2) 


Although the ideal filter characteristics are desirable, they are not absolutely nec- 
essary in most practical applications. If we relax these conditions, it is possible to 
realize causal filters that approximate the ideal filters. The magnitude characteristics 
of such a filter ( low-pass) is shown in Fig. 14.2. In the pass-band and stop-band 
of the filter, you may note that the magnitude response is deviated from the ideal 
characteristics. These deviations are specified by the pass-band (denoted as 61) and 
stop-band (denoted as 62) ripples. It may also be noted that there exist a transition 
band (@s — œp) in a practical filter where as it is absent in an ideal filter. 

In any filter design problem, we can specify, (i) the maximum tolerable pass-band 
ripple, (ii) the maximum tolerable stop-band ripple, (iii) pass-band edge frequency 
(wp), and (iv) the stop-band edge frequency (œs). Based on these specifications, 
we can select the parameters {ag} and {bg} in the frequency response characteristics 
given by Eq. (14.2), which best approximates the desired specifications. The degree 
to which H (œ) approximates the specifications depends on the criterion used in 
the selection of the filter coefficients {ag} and {by} as well as on N and M. 


14.2 Design of FIR Filters 


In this section, we discuss three different methods for the design of linear phase 
FIR digital filters. They are: 
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e Windowing 
e Frequency Sampling 
e Optimization Method 


14.21 Symmetric and Anti-symmetric FIR Filters 


An FIR filter of length M with input x[n] and output y[n] can be described by the 
difference equation 


y[n] = box[n] + by x[n — 1] +...+by-1x[n -M+4+ 1] => byx[n — 


where {bx} is the set of filter coefficients. Alternatively, the output of the filter can 
be described as the convolution of the input and the filters impulse response h[n]. 
Thus we have, 


M-1 


yin] = È, hlk xin — kl. (14.4) 
k=0 


Here, the lower and upper limits of the convolution sum reflect the causality and 
finite-duration characteristics of the filter. Clearly Eq. (14.3) and Eq. (14.4) are 
identical in their form and hence by = h[k], k = 0,1,..., M — 1. The filter can 
also be characterized by its system function 


H(z) = Do hikz. (14.5) 


The roots of the above polynomial constitutes the zeros of the filter. 
An FIR filter has linear phase if it satisfies the condition 


hin] = th[M -—1—n], n=0,1,...,M — 1. (14.6) 


When the symmetry (+) and anti-symmetry (—) conditions are incorporated in 
Eq. (14.5), we have, 


H(z) = h[0] + A[1]z7! +... + AIM — 1427! (14.7) 


z IM—I1/2 tha} for M odd 


14. 
z7M-1/2 {hen} for M even =) 


= 1 =| 
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Unit. ——” 
circle 
FFL 
Z3 


where 


M-3 
ZŁ —1—2n —1-2n 
hoda =h [=| + >, ah pi Pli e )], (14.9) 
2-1 (Y=) (==) 
heven = 5 h{n] E ? +z 5 | (14.10) 
n=0 


Now, if we substitute z~! for z in Eq. (14.5) and multiply both sides of the 


M-1] 


equation by z`! , We get 


z7™M-1H (z7!) = +H (z). (14.11) 


This implies that the roots of the polynomial H (z) are identical to the roots of 
the polynomial H(z~!). That is, the roots of H(z) must occur in reciprocal pairs. 
That is if z1 is a root or zero of H(z), then 1/z, is also a root. Furthermore, if the 
impulse response h[n] of the filter is real, then the complex valued roots must occur 
in conjugate pairs. Hence if z1 is a complex valued root, then zj is also a root. H (z) 
also has a root at 1/z}. Figure 14.3 shows all these for the case of a linear phase FIR 
filter. 

The frequency response characteristics H (œ) of the linear-phase FIR filters are 
obtained by evaluating Eq. (14.8) on the unit circle. 
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When h[n] = h[M — 1 — n] (i.e., symmetric linear phase FIR filter): H(@) can 
be expressed as 


H() = H, (oye 2 |, (14.12) 


where H, (œ) is a real function of œ and can be expressed as 


M-3 
M-1 Ez M-1 
mo =| “| +2 3 hlneoso| -n|, (14.13) 
when M is odd. 
Mı 
M -1 
mo =2 È noo] 5 =). (14.14) 


when M is even. 
The phase characteristics of the filter for both odd and even M are 


-o |]. if H,(w) > 0 
O(w) = (14.15) 
-o |] +z, if H-(@) <0. 


When h[n] = —h[M — 1 — n] (i.e., anti-symmetric linear phase FIR filter): The 
unit sample response is anti-symmetric. For M odd, the centre point of the anti- 


symmetric h[n] isn = Met. Hence, 


M-1 
h “| =0. (14.16) 


However, if M is even, each term in h[n] has a matching term of opposite sign. 
The frequency response of this anti-symmetric FIR filter is 


H(@) = Helle +8], (14.17) 


where 
M-3 


2 
H,(o) =2 >> h{n]sinw |= — 


n=0 


: =}. (14.18) 


Design of FIR Filters 289 


when M is odd and 


z371 = 
H,(w) = 2 5 h{n] sino | : =n]. (14.19) 


n=0 


when M is even. The corresponding phase characteristics of the the filter are 


Z- o|]. if H-(@)>0 
O(a) = (14.20) 


z @ [M4], if H,(@) <0 


These general frequency response formulas can be used to design linear-phase 
FIR filters with symmetric and anti-symmetric impulse responses. The number of 
filter coefficients that specify the frequency response for different types of filters is 
shown in Table 14.1 below: 


Table 14.1. Number of filter coefficients 
that specify the frequency response of dif- 


ferent types of FIR filters. 


Filter type M odd M even 
Symmetric aut 4 
Anti-symmetric wt ; 4 
-1 
h [ 2 ] =0 


14.2.2 Design of Linear-Phase FIR Digital Filters Using 
Windowing 


We begin with the desired frequency response specification Hg(@) and determine 
the corresponding unit sample response hg[n]. We have (Ha (œ) © haln]), 


Ha(o) = > halni”, (14.21) 
n=0 


where 
1 4 ; 
ha{n] = — Ha loje”. (14.22) 
2a Jin 
So, given Ha(œ), the unit sample response hg[n] can be evaluated using 
Eq. (14.22). In general, this hg[n] is infifite in duration and must be truncated 
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at some point, say atn = M — 1, to provide a finite length (order M) FIR filter. 
This truncation is equivalent to multiplying hg[n] by a finite “rectangular window’, 


defined as 


win [Bane onan 
Thus the unit sample response of the FIR filter becomes 
hin] = ha[n|w[n] (14.24) 
which means that, 
ptm ld engot- aay 


We have to see the effect of this multiplication on the desired frequency response 
Hq(q). To see this, recall the multiplication in time domain is equivalent to the 
convolution of Hg(@) and W(@) = >). w[nje~/@" (Fourier transform of 
w[n]) in the frequency domain. Thus, 


1 T 
H (œ) = =f Hav) W (œ — v)dv (14.26) 
T J—r 
We have 
M-1 
W(o) = ein 
n=0 
1- e JOM 
1—eJe 
— ¿-jolM-11/2 sin(@M /2) (14.27) 
sin(@/2) J l 
This function has a magnitude response 
| sin(@M /2)| 
W = ——, — < < 14.28 
|W (o)| \sin(w/3)| TS OST (14.28) 
and a piece-wise linear phase 
-o |*=] when sin(@M/2) > 0 


O(a) = | (14.29) 


—o [4+] +a, when sin(aM/2) <0. 


The magnitude response of the window function is shown in Fig. 14.4 for 
M =3landM = 61. The width of the main lobe is =. Hence as M increases, the 
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Figure 14.4. Frequency response for rectangular window of length (a) M = 31, (b) M = 61. 


main lobe becomes narrower. However, the side-lobes of |W (œ)| are relatively high 
and remain unaffected by an increase in M. In fact, even though the width of each 
side-lobe decreases with an increase in M the height of each side-lobe increases with 
an increase in M in sucha manner that the area under each side-lobe remains invari- 
ant to changes in M. This characteristic behaviour is not evident from Fig. 14.4 
because W (œ) has been normalized by M such that the normalized peak values of 
the side lobes remain invariant to an increase in M. The characteristics of the rect- 
angular window plays a significant role in determining the frequency response of the 
truncated unit impulse response. Specifically, the convolution of Ha (œ) with W (œ) 
has the effect of smoothing Ha (œ). As M increases, W (œ) becomes narrower, and 
the smoothing is reduced. On the other hand, the large side lobes of W (œ) result 
in some undesirable ringing’ effects in the FIR filter frequency response H (œ) and 
also in relatively large side lobes of H (œ). These undesirable effects can be mini- 
mized by using other types of windows that do not contain abrupt discontinuities 
in their time-domain characteristics, and have correspondingly low side lobes in 
their frequency domain characteristics. 

Several popular non-rectangular window types are listed in Table 14.2. Figure 
14.5 illustrates the time-domain characteristics of those windows for length M = 
61. The frequency response characteristics of the most commonly used non- 
rectangular windows, such as, Hanning, Hamming, and Blackman windows for 
different window lengths are illustrated in Figs.14.6 through Fig. 14.8. 

All of these window functions have significantly lower side-lobes compared to 
the rectangular window. However, for the same value of M, the width of the main 
lobe is also wider compared to the rectangular window. As a result, these window 
functions provide more smoothing and as a result, the transition region in the FIR 
filter is wider. To reduce the width of this transition region, we can simply increase 


1. Gibb’s phenomenon discussed earlier. 
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Table 14.2. Time domain description of popular window functions of length M. 


Name of Window 


Time-domain Sequence (w[7]) 


Kaiser 


Bartlett 
Blackman 
Tukey 
Hamming 
Hanning 
Triangular 
Gaussian 


Parzen 


Bohman! 


Chebyshev 


0.42 — 0.5 cos fet + 0.08 cos os 


4 [1 + cos (Ae OP m) | a(M — 1)/2 < |h- m| zM 


0.54 — 0.46 cos 22% 


wo ( = 4), 0 <M 
J M+1 

wo(n) = 1-6 (arn) (1- chy) Dens ae 

2(1- wt 7z) , Mtl < jn] < MH 
sin (57) = cos (47 — 5), O<n <M. 
Wet Yio mee ar”, O0<n<M, 

T; ak 
mo = weeh), O<k<M, 

cos O) if -1<x<1, 
Tn (x) = 4 cosh (n cosh™! (x)) if x > 1, 


lA 
l 
Ea 


(—1)” cosh (n cosh! (—x)) if x 


! This window function is also known as the half-sine window or half-cosine window. 


the length of the window, which results in higher order filter. Table 14.3 summarizes 


the important frequency domain features of the various window functions. 


Example: Suppose that we want to design a symmetric low-pass linear phase FIR 


filter having the following (desired) frequency response: 


Ha (œ) = | 


le~JolM—-1/2 for 0 < |a| < we 


0 otherwise 
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Magnitude 


Rectangular 
Hamming 
Hanning 


Magnitude 


Window Length 


Figure 14.5. Shapes of different types of windows. 


Magnitude (dB) 
5 


Normalized Frequency 


Figure 14.6. Frequency response for Hanning window of length (a) M = 31, (b) M = 61. 


A delay of [M — 1]/2 units is incorporated into H4 (œ) in anticipation of forcing 
the filter to be of length M. The corresponding sample response is 


1% ofyn M 
ha{n] = =| jol 2 lao 
T J—o, 
. M-1 
Oc |n — > M-1 
a na l a Tae (14.30) 
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Figure 14.7. Frequency response for Hamming window of length (a) M = 31, (b) M = 61. 
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Figure 14.8. Frequency response for Blackman window of length (a) M = 31, (b) M = 61. 


Table 14.3. Important frequency characteristics of most 


commonly referred types of windows. 


Approx. transition 


Window width of main lobe Peak side lobe (dB) 


4r 


Rectangular iT -13 
Bartlett ax —25 
Hanning 8z -31 
Hamming oe —41 
Blackman lop. —57 


Clearly, hg[n] is non-causal and infinite duration. If we multiply hg[n] by the 
rectangular window (of length M), we obtain a FIR filter of length M having the 
unit sample response 


M-1 
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Figure 14.9. Low-pass FIR filter designed with rectangular window: (a) M = 61 and (b) 
M = 101. 


If M is selected to be odd, the value of h[n] atn = [M — 1]/2 is 


h “=| = (14.32) 
2 T 


The magnitude of the frequency response H (œ) of this low pass filter (with cut off 
@c = 0.1) for M = 61 and M = 101 is illustrated in Fig. 14.9. The relatively large 
oscillations (ripples) near the band edge is due to the Gibbs phenomenon (more 
when use the rectangular window). As the filter length increases, the transition band 
decreases and the transition from pass band to stop band becomes sharper. 

For a comparison, the magnitude responses of the same filter designed using 
different types of windows (Rectangular, Hamming, Blackman, and Kaiser) with a 
filter length, M = 61, are shown in Figs. 14.10(a)—(d). It may be observed that the 
design with rectangular window provides the sharp cut off characteristics however, 
its side lobe levels are the highest among the 4 characteristics. The width of the main 
lobe of the filter characteristics for the designs with non-rectangular windows (Figs. 
14.10(b)—(d)) are higher than that with the rectangular window. On the other hand, 
the side lobes, as you can see, are much lower for these designs compared to the 
rectangular window. Gibb’s phenomenon is clearly visible in the case of rectangular 
window (Fig. 14.10(a)). 
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Figure 14.10. Low-pass FIR filter designed with different types of windows of length 
M = 61: (a) Rectangular window, (b) Hamming window, (c) Blackman window, and (d) 
Kaiser window. 


14.2.3 Design of Linear-Phase FIR Filters by the Frequency 
Sampling Method 


Remember the frequency sampling structure of the FIR systems which we have 
discussed earlier in Section 11.2.3. In this method of FIR filter design, we specify 
the desired frequency response Hg (œ) at a set of M equally spaced frequencies, 
namely, 


oO = —., (14.33) 


where k = 0,1,...,4 4 for odd values of M, k = 0,1,...,4 — 1 for even 
values of M and solve for the impulse response h[n] of the FIR filter. To reduce 
side lobes, the frequency specifications in the transition band may be optimized 
(numerically) by using linear programming techniques. 

To simplify the computations, we can exploit the symmetry property of the sam- 
pled frequency response. Let us begin with the desired frequency response of the 
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FIR filter, 
M-1 l 
Ha(o) = X hine. (14.34) 
n=0 


Suppose that we specify the frequency response of the filter at the frequencies given 
by Eq. (14.33). Then from Eq. (14.34), we get (for k = 0, 1,..., M — 1), 


2mk 
Halk] = Ha (=). 


M-1 
+ 2nk 
= > Alnje i". (14.35) 
n=0 


Taking the inverse of Eq. (14.35) will give h[n]. Multiplying both sides of 
Eq. (14.35) by frm, m = 0,1,...,M — 1 and taking the sum over k = 
0,1,..., M — 1, the right-hand side of this equation reduces to Mh[m]. Thus we 
obtain (for n = 0,1,..., M — 1), 


M-1 
h{n] = Ș Halkle i”, (14.36) 
k=0 
Note that Eq. (14.35) is the DFT of the sequence {h[n]} and Eq. (14.36) is its 
IDFT. 
Since h[n] is real, we can easily show that the frequency samples Hy[k] satisfy 
the symmetry condition 


Halk] = HŽ[M — k]. (14.37) 


This symmetry condition along with the symmetry of h[n] can be used to reduce 
the frequency specifications from M to (M + 1)/2 points for odd values of M and 
M/2 points for even values of M. This reduces the computational requirement 
considerably. In particular, if Eq. (14.17) is simplified at the frequencies, œp = 
ark k=0,1,...,M — 1, we obtain, 


21k i| pH 2k py 
Halk] = H, (=) Pale: 2M [M uj (14.38) 


where 8 = 0 when {h[n]} is symmetric and p = 1 when {h[n]} is anti-symmetric. 
A simplification occurs by defining a set of real frequency samples {G[k]} 
20k 


G[k] = (-1)*H, (=). k=0,1,..., M =1. (14.39) 
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We use Eq. (14.39) in Eq. (14.38) to eliminate H, (œg). Thus we obtain, 


. (| pz _2ak rag _ 
Halk] = Gtel®™ Deel? 53pm] (14.40) 


Now the symmetric condition for Hg[k] in Eq. (14.37) translates into a cor- 
responding symmetry condition for G[k], which can be exploited by substituting 
into Eq. (14.36), to simplify the expressions for the FIR filter impulse response 
{h[n]} for the two cases $ = 0 and £ = 1. The results are summarized below: 


When h[n] = h[M — 1 — n] (symmetric: 6 = 0): 


Mide6he@. k=0,1,...,M—1 
k 2ak 
G[k] = (—1)* H, ova ; G[k] = —G[M — k] 


M odd: 
Mot 
1 27k 1 
h = 2 k — = : 14.41 
[n] 7 G[0] + a ] cos vi (n+ 5) ( ) 
M even: 
1 a 2nk 1 
T 
hin] = a G[0] +2 2 G[k] cos E73 (» + 5) . (14.42) 
When h[n] = —A[M — 1 — n] (anti-symmetric: £ = 1)): 
Halk] = Gik] ži T, k=0,1,...,M—1 
k 2ak 
G[k] = (—1)°H, ava ; G[k] = G[M — k] 
M odd: 
Ea 2k 1 
2 _ 2m 
hin =— > 2d G[k] sin = (x + ;). (14.43) 
M even 
Mı 
1 M 21k 1 
hin] = — 4 (-1)"*'G (>) -2 k] sin —— Z 
[n] M (—1) e(%) > ows i (n+) 


(14.44) 


Design of FIR Filters 299 


Example: Determine the coefficients of a linear-phase FIR filter of length M = 15 
which has a symmetric unit sample response and frequency response that satisfies 
the conditions 


1 for k = 0, 1,2,3 


2ak 
H, (=) = 104 fork =4 (14.45) 
0 for k=5,6,7 


Since h[n] is symmetric, we use the corresponding formula from the four cases 
described earlier. In this case, 


Gk] = (-1* H, (=). k=-0,1,...,7 (14.46) 


The result of this computation is 


h[0] = —0.014112893 = h[14] 
h[1] = —0.001945309 = h[13] 
h[2] = 0.04000004 = h[12] 
h[3] = 0.01223454 = h[11] 
h[4] = —0.09138802 = h[10] 
h[5] = —0.01808986 = A[9] 
h[6] = 0.3133176 = A[8] 

h[7] = 0.52 = h[7] 


The frequency response characteristic of this filter is shown in Fig. 14.11. We 
should emphasize that H, (œ) is exactly equal to the values given by the specifica- 


tions above at œk = a 


14.2.4 Design of Optimum Equiripple Linear-Phase FIR Filters 


The window method and the frequency sampling method are relatively simple 
techniques for the design of linear-phase FIR filters. However, they have some dis- 
advantages which may render them undesirable for some applications. They are: 


e Lack of precise control of the critical frequencies such as œp and œs. We have 
to accept whatever values we obtain after the design. 

e We cannot specify both 6; and 62 ripple factors simultaneously. Either we 
have to specify 6; = 62 in the window method or we can optimize only 62 
in the frequency sampling method. 

e The approximation errors between the ideal and the actual responses is not 
uniformly distributed in the frequency bands. It is higher near the band 
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Figure 14.11. Impulse response and frequency response of the linear-phase FIR filter 
(Example 2). 


edges and lower in frequency regions away from band edges. By distribut- 
ing the error uniformly, we can obtain a lower-order filter satisfying the same 
specifications. 


To overcome these problems, an optimization method, named as the Parks—M- 
cClellan algorithm for the design of FIR filters have been proposed.* The goal of 
the algorithm is to minimize the error in the pass and stop bands by utilizing the 
Chebyshev approximation. It has become a standard method for FIR filter design. 

The optimization method described in this section is formulated as a Chebyshev 
approximation problem. In this method, the weighted approximation error 
between the desired frequency response and the actual frequency response is spread 
evenly across the pass-band and the stop-band of the filter by minimizing the 
maximum error. 

To describe the design procedure, let us consider the design of a low pass 
linear-phase FIR filter with a pass-band edge frequency œp and stop-band edge 


2. J.H. McClellan and T.W. Parks, “A personal history of the Parks-McClellan algorithm”, ZEEE Signal Process- 
ing Magazine, vol. 22, No. 2, pp. 82-86, 2005. 
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frequency ws. From the general specifications given in Fig. 14.2, we can write 
1-3) < H,(w) <146, |] < op, (14.47) 
and 
— 0. < H,(@) < &, lol > ws. (14.48) 


Here, 6; and 62 represents the pass-band and stop-band ripples, respectively. The 
remaining filter parameter is its length M. 

Let us focus on the four different cases that result in a linear-phase FIR filter. To 
derive a standard (compact) objective function for all these four cases, the following 
manipulations are suggested: 


© Case 1: h[n] = h[M — 1 — n] (symmetric) and M odd: In this case, the 
real valued frequency response characteristics is 


M-3 
H,(w) =h a= 420k wes (14.49) 
7 (@) = oe a [n] cos œ 7 —n|. : 
If we let k = [++ — n and define a new set of filter parameters {a[k]} as 
_ fh [“+] for k = 0, 
eas [7 8] or 1,2) ia 
then Eq. (14.49) reduces to the compact form 
M=1 
7 
H, (@) = `> afk] cos œk. (14.51) 
k=0 
© Case 2: h[n] = h[M — 1 — n] (symmetric) and M even: 
= M-1 
H, (@) = 2 2 h[n]cos@ | — J (14.52) 


By letting k = [4] —n and defining a new set of filter parameters {b[k]} as 


blk] = 2h [$-a], k=1,2,...,M/2 (14.53) 
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Then, Eq. (14.52) becomes 


M 


H, (0) = > blk] cos w |k - z| (14.54) 


k=1 


This can be further modified to 


Mi 
H,(@) = cos S 2 b[k] cos œk, (14.55) 
where 
b[0] = soll (14.56) 
b[k] = 2b[k] — [k —1], k =1,2,..., > — 2 (14.57) 
[M M 
b E = 1 = 95 Z : (14.58) 


© Case 3: h[n] = —h[M — 1 — n] (anti-symmetric) and M odd: 


M-3 


2 
H,(o) =2 >” Ahfn]sino |= = 


n=0 


a J (14.59) 


By setting k = [Z] —n and define a new set of filter parameters {c[k]} as 


M-1 
c[k] = 2h z- k= 1,2,...,[M _— 1]/2 (14.60) 


Then Eq. (14.59) becomes 


M-1 

“a 
H,() = X clk] sin ok (14.61) 

k=1 

This is further modified to 
M-3 
2 

H,(@) = sin œ > c[k] cos œk (14.62) 


k=0 
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where 


M-—5 


cik — 1] — c[k + 1] = 2c[k], 2 < k < 7 


1 
c[O] + 712] = c[1]. 


© Case 4: h[n] = —h[M — 1 — n] (anti-symmetric) and M even: 


M 
M] 


H,(@) =2 > h{n|sinw E a J 


n=0 
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(14.63) 


(14.64) 


(14.65) 


(14.66) 


(14.67) 


A change of summation index by setting k = M — n combined with a defi- 


nition of a new set of filter parameters {d[k]} according to 


d[k] = 2h - k k=1,2 ag 
= 2 ’ a 5) acs 


This results in 


M 


2 
H,(o) = Si dik sin@ k — zl 


k=1 
This can be further modified to 
“Mi 


H,.(@) = sin 5 2 d[k] cos wk 


where, 


(14.68) 


(14.69) 


(14.70) 


(14.71) 
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dik —1]—d[k] =2d[k], 2<k< > =; (14.72) 
d[0] — tän] = d[{l]. (14.73) 


We note that the rearrangements in Case 2, Case 3, and Case 4 have allowed 
us to express H, (œ) in a more compact form as 


H,(@) = O(@)P(@), (14.74) 


where Q(@) and P (œ) for each case is shown in Table 14.4 below. 


Table 14.4. Filter types and the correspond- 


ing Q(@) and P(w) functions. 


Filter type Q(@) P(o) 

Case 1 1 ee alk] cos œk 
Case 2 cos 5 ne ona b[k] cos wk 
Case 3 sin @ ele c[k] cos wk 
Case 4 sin 3 eee d[k] cos wk 


It may be noted that here P(@) has a common form 


L 
P(@) = > alk] cos ok, (14.75) 
k=0 


with {a[k]} representing the parameters of the filter which are linearly related to the 
unit sample response h[n] of the FIR filter and the upper limit in the summation 
L is different for different cases as can be seen from the table. 

In addition to the common framework given above, we also define the real- 
valued desired frequency response Hg; (œ) (unity in the pass-band and zero in the 
stop-band. See Fig. 14.1 for the illustration of Har (œ) for different types filters.) 
and the weighting function W (œw) on the approximation error. This W (œ) allows 
us to choose the relative size of the errors in the different frequency bands. In 
particular, it is convenient to normalize W (œ) to unity in the stop-band and set 


W (œ) = 62/0, in the pass-band, that is, 


ô2 i í 
Wo) = |; @ in the pass-band (14.76) 


1 @ inthe stop-band 
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The weighted approximation error is defined as 
E(w) = W(@) [Har (@) — H, (œ)] 
= W (w) [Har (œ) — Q(@)P@)] 


S Hır (œ) 
= W(a)Q(@) | oa P| 


= Wo) | Har u= P(o)] (14.77) 


for all four different types of linear-phase FIR filters. 

Given the error function E (œ), the Chebyshev approximation problem is to 
determine the filter parameters {a [k]} that minimizes the maximum absolute value 
of E (œ) over the frequency bands in which the approximation is to be performed. 
In mathematical terms, this can be written as 


min [egio] = min os (14.78) 


over[a[k]] | wes ovet[a[k] 


where 


(14.79) 


XX = max 
wes 


L 
Wo) Ç (@)— », a[k] cos g 


k=0 


In Eq. (14.78), S is the set (disjoint union) of frequency bands over which the 
optimization is to be performed. This set consists of the pass-bands and stop-bands 
of the desired filter. 

The solution to the optimization problem in Eq. (14.78) is given by Parks and 
McClellan (1972) by applying the alternation’ theorem to the theory of Chebyshev 
approximation. 

To elaborate on the alternation theorem, let us consider the design of a low- 
pass filter with pass-band 0 < œ < œp and stop-band @s < œ < m. Since the 
desired frequency response Har (œ) and the weighting function W (œ) are piece- 
wise constant, we have, 


d 
HO) = won 
da do 
_ _dH,(@) -o (14.80) 
dœ 


3. Alternation Theorem: Let S$ be a compact subset of the interval [0, 7). A necessary and sufficient 
condition for P(@) in Eq. (14.75) to be unique, best weighted Chebyshev approximation to Hay (œ) in 
S, is that the error function E(@) exhibit at least L + 2 extremal frequencies in S. That is, there must 
exist at least L + 2 frequencies {@;} in S such that œ < œ < ... < @L+2, E(w) = —E(@;41), and 
IE(@i)| = maxges IE(@)l, i =1,2,..., L +2. 
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Consequently, the frequencies {@;} corresponding to the peaks of E (œ) also corre- 
sponds to peaks at which H, (œ) meets the error tolerance. Since H, (œ) is a trigono- 
metric polynomial of degree L, for Case 1, for example, 


L 
H,.(@) = > a[k] cos wk 
k=0 


L k 
= J alk) bs Buk (cos or 
k=0 n=0 


L 
= $ o'k] (cos œ)". (14.81) 


k=0 


It follows that H, (œ) can have at most L — 1 local maxima and minima in the open 
interval 0 < œ < z. In addition, œ = 0 and œ = 7 are usually extrema of H, (œ) 
and, also, of E (œ). Therefore, H, (œ) has at most L + 1 extremal frequencies. 
Furthermore, the band edge frequencies œp and œs are also extrema of E (œ) since 
|E(@)| is maximum at @ = @p and w = ws. Hence there are at most L + 3 
extremal frequencies in E (œ) for the unique, best approximation of the ideal low- 
pass filter. On the other hand, the alternation theorem states that there are at least 
L +2 extremal frequencies in E (œ). Thus the error function for the low-pass filter 
design has either L + 3 or L + 2 extrema. 

The alternation theorem guarantees a unique solution for the optimization prob- 
lem in Eq. (14.78). At the desired extremal frequencies {@n}, we have the set of 
equations, 


W (@n) Har (@n) — Plon] = [-1]"6, n=0,1,...,L+1 (14.82) 


where ô is the maximum value of the error function E (œ). If we select W (œ) by 
Eq. (14.76), it follows that ô = 62. The set of linear equations in Eq. (14.82) can 
be rearranged as 


[=e 


Qn 


P(a@n) + = Ha; (On), n=0,1,...,L +1 (14.83) 


where 


L 
P(n) = >» alk] cos onk (14.84) 
k=0 
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Filter Specifications 
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Figure 14.12. Flowchart of Remez algorithm. 


Here, {a[k]} and ô are the parameters to be determined by solving the L + 1 
equations (Eq. (14.83)). Initially we do not know either the set of extremal fre- 
quencies {@,} or the parameters {a[k]} and ô. An iterative approach,* known as 
te Remez Exchange Algorithm can be used to solve for the parameters [5]. In this 
algorithm, by guessing the set of extremal frequencies, determine P (œ) and 6 and 
then compute the error function E (œ). From this E(@), we determine another set 
of L +2 extremal frequencies and repeat the process iteratively until it converges to 


4. Rabiner et al. (1975) have proposed a more efficient method. 
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the optimal set of extremal frequencies. Figure 14.12 shows the flowchart of Remez 
algorithm. 

A computer programme written by Parks and McClellan is available for design- 
ing linear-phase FIR filters of different types using the optimization method just 
described in this sub-section. 

The Remez programme requires a number of input parameters which determine 
the filter characteristics. The following parameters must be specified: 


e NEFILT: Filter length (M) 

e JTYPE: Type of filter (1 (multiple passband/stopband), 2 (differentiator), 3 
(Hilbert transformer)) 

e NBANDS: Number of frequency bands (2—10) 

e LGRID: Grid density for interpolating the error function E(@) (default 
value is 16) 

e EDGE: Frequency bands specified by lower and upper cutoff frequencies (up 
to maximum of 10 bands) 

e FX: Array of maximum size 10 that specifies the desired frequency response 
in each band 

e WTX: Array of maximum size 10 that specifies the weight function in each 


band 


Example: Design a low-pass filter of length M = 61 with a pass-band frequency 
fp = 0.1 and a stop-band frequency fs = 0.15. 

The low pass filter is a two band filter with pass band edge frequencies (0, 0.1) 
and stop-band edge frequencies (0.15, 0.5). The desired response is (1,0) and the 
weight function is arbitrarily selected as (1,1). 

NFILT = 61,JTYPE = 1,NBANDS = 2(0.0,0.1,0.15,0.5), FX = 
1.0, 0.0, WTX = 1.0, 1.0 

The impulse response and the frequency response of the designed filter are shown 
in Fig. 14.13. The resulting filter has a stop band attenuation of —56dB and a pass 
band ripple of 0.0135 dB. 

If we increase the length of the filter to 101, keeping all the other parameters 
same, the resulting filter has an impulse response and frequency response as shown 
in Fig. 14.14. Here, the stop-band attenuation is —85dB and the pass-band ripple 
has reduced to 0.00046 dB. 


14.3 Design of IIR Filters 


UR filters have infinite-duration impulse responses. It is easy to match those to ana- 
log filters which generally have infinitely-long impulse response. There are several 
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Figure 14.13. Impulse response and frequency response of the designed filter in 
Example. 


methods that can be used for the design of IIR filters. The techniques described in 
this section are all based on converting an analog filter into a digital filter. Here, 
three such schemes are discussed. They are: 


e Design by approximation of derivatives 

e Design by impulse invariance (preserves the shape of the impulse response) 

e Design by bilinear transformation (preserves the system function 
representation) 


14.31 Design of IIR Filters From Analog Filters 


Analog filter design is a mature and well-developed field. We begin the design of 
a digital filter in the analog domain and then convert the design into the digital 
domain by complex-valued mapping. 

An analog filter can be described by its system function, 


_ Bis) _ Dko Ars 
A(s) E oars 


(14.85) 
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Figure 14.14. Impulse response and frequency response of the designed filter in 
Example. 


where, ag and fx are the filter coefficients, or by its impulse response, which is 


related to Ha(s) by the Laplace transform 
CO 

Ha(s) = | h(t)e*'dt. (14.86) 
—00 


An analog filter having the rational system function H,(s) can be described by 
the linear constant coefficient differential equation as 


N k 
ya a -Yp e (14.87) 


dtk dtk 
k=0 


where x(t) and y(t) are the input and output, respectively of the system. 

Each of these three equivalent characterization of an analog filter leads to alter- 
native methods for converting them into the digital domain. 

We recall that an analog LTI system with system function H,(s) is stable if all 
its poles lie in the left half of the s-plane. Accordingly, if the conversion technique 
is to be effective, it should posses the following desirable properties: 


e The jQ axis in the s-plane should map into the unit circle in the z-plane. 
This means that the frequencies in s and z domains are directly related. 
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Figure 14.15. Frequency domain equivalent. 


e The LHP of the s-plane should map into the interior of the unit circle in 
the z-plane. Thus a stable analog filter will be converted into a stable digital 
filter. 


In the design of IIR filters, we shall specify the desired filter characteristics for 
the magnitude response only and accepts the phase response that is obtained from 
the design methodology. 


14.3.2 IIR Filter Design by Approximation of Derivatives 


It is known that a differential equation can be approximated by an equivalent dif- 
ference equation. This approach is used to find the equivalent difference equa- 
tion representation of Eq. (14.87). The derivative ay at time instant t = nT, is 


approximated by the difference equation as follows: 


dy(t) L y(nT;) — y(nTs — Ts) 
dt lear T 
_ y[n] — yln — 1] (14.88) 
T; 


where Ts is the sampling interval and y[n] = y(nT;). The analog differentiator 
with its output aw has a system function H (s) = s, while its digital counterpart 
l1—z 


has the system function H(z) = m (see Fig. 14.15). The frequency domain 


equivalent for the relationship in Eq. (14.88) is 


S = 
Ts 


(14.89) 
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The second derivative is replaced by the second difference equation as below: 


d*y(t —2y[n-1 -2 
ae _ yin] = 2yIn nisa ] (14.90) 
dt t=nT, To 
In the frequency domain, it is equivalent to 
2 
1—27! +z? 1- z7! 
2 
= = : 14.91 
` T ( T ) a 
Similarly, the kth derivative of y(t) results in the equivalent frequency domain 
relationship 
k 
; 1= z7! 
k 
= : 14.92 
> ( T ) R 


Hence the system function for the digital IIR filter obtained as a result of the 
approximation of the derivatives by finite difference is 


H(z) = Ha(s)| _ 1- (14.93) 
s= 
Implications: The mapping from s-plane to z-plane as given in Eq. (14.89) or 
equivalently, 

Se (14.94) 

thes oe l 

If we substitute s = jQ in the above equation, we get 

T E (14.95) 

= 740272 T IFE l 


As Q varies from —0o to 00, the corresponding locus of points in the z-plane is 
a circle of radius 0.5 and with centre at (0.5, 0), as illustrated in Fig. 14.16. 

It can be shown that the mapping in Eq. (14.94) takes points on the LHP of the 
s-plane into corresponding points inside this circle in the z-plane, and points in 
the RHP of the s-plane are mapped into points outside this circle. So, though the 
mapping preserves the stability, the range of frequencies are limited and as a result, 
the mapping is restricted to the design of low-pass and band-pass filters having 
relatively small resonant frequencies. It is not possible, for example, to transform a 
high-pass analog filter into a corresponding high-pass digital filter. 
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Unit circle 


Figure 14.16. The mapping from s-plane to z-plane. 


To overcome this problem, a L'” order difference equation has been proposed 
as follows: 


dyt) 
dt 


14. 
T, (14.96) 


L 
2 Ssa +kT;) — y(nT; — kT;) 
k=1 


t=nT; 


where ag are a set of parameters that can be chosen to optimize the approximation. 
The resulting mapping is 


ic 
s=—Y azt- z™%). (14.97) 
T; 
k=1 
When z = e/”, we have 
> L 
s=j> ak sin œk, (14.98) 
which is purely imaginary. Thus, 
> L 
Q= 2 ar sin œk, (14.99) 


is the resulting mapping between the two frequency variables. By proper choice of 
the aæg’s, it is possible to map the jQ-axis into the unit circle. Furthermore, the 
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points in the LHP of the s-plane is mapped into the unit circle. The problem here 
is the selection of the ag’s which is in general a difficult one. 


14.3.3 IIR Filter Design by Impulse Invariance 


In this method, the objective is to design an IIR filter having a unit sample response 
h[n] that is the sampled version of the impulse response h(t) of the analog filter. 
That is, 


h[n] =hg(nT;), n=0,1,... (14.100) 


where Ts is the sampling interval. Using the rule of the spectrum of a sampled 
signal, the spectral relationship of Eq. (14.100) can be shown to be 


H(f)=fs > Half —kfs) (14.101) 


k=— o0 


where f is the analog frequency, fs = 1/T; is the sampling frequency. As you 
can see, a scaled version (scaled by fs) of the original spectrum repeats on either 
side of the frequency axis at a rate of fs Hz. 

Equation (14.101) can be written as a function of the normalized frequency, 


f= £ as follows: 


CO 


H =f > Ha((F-*) A) (14.102) 


k=—00 
Equation (14.102) is also equivalently 


CO 


H(o) = fs >) Ha((@ — 2k) fs), (14.103) 
k=— œ 
where œ = 2x f. This equation can be re-written as, 


CO 


1 27k 
HQ) == >) Ha (2- s ). (14.104) 
S =—00 S 


as the analog and digital frequencies are related by œ = QT, or e/® = e/ 9%, Since 
z = e/® on the unit circle, s = jQ on the imaginary axis, we have the mapping 
z= ests. 

Figure 14.17 depicts the frequency responses of a low-pass analog filter and the 
corresponding digital filter. It is noted that the sampling interval Ts is to be chosen 
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—50T, 0 507; or; 


Figure 14.17. Frequency response H,(Q) of the analog filter and the corresponding digital 
filter with aliasing. 


small enough to avoid the effects of aliasing. It is also clear that the impulse invari- 
ance method is inappropriate for designing high-pass filters due to the spectrum 
aliasing that results form the sampling process. 

To investigate the mapping of points between the two planes, we rely on a gen- 
eralization of Eq. (14.104) which relates the z-transform of h[n] to the Laplace 
transform of hg(t). The relationship is 


—= 27k 
H (Z)lz=esTs = F 2 H,(s—j I (14.105) 
where 
CO 
H) = $ hinke™” (14.106) 
n=0 
(0,0) 
H @)lz=es = > bine" (14.107) 
n=0 
Note that when s = jQ, Eq. (14.105) reduces to Eq. (14.104). Let us consider 


the mapping of points from s-plane to the z-plane implied by the relation z = es”. 


If we substitute s = o + jQ and express the complex variable z in polar form, we 
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get 
rei? = e? Ts eIQTs (14.108) 
Clearly, we must have 
pa" (14.109) 
o= QT, (14.110) 


Correspondingly, o < 0 implies that O < r < 1 ando > Oimpliesr > 1. 
When o = 0, we have r = 1. Therefore, the LHP of the s-plane is mapped inside 
the unit circle in z-plane and the RHP in s-plane is mapped to the outside of the 
unit circle in the z-plane. 

Also, the jQ-axis is mapped onto the unit circle in z domain. However, the 
mapping of the jQ-axis onto the unit circle is not one-to-one. Since œ is unique 
over the range (—7, z), the mapping œ = QT; implies that the interval -7 < 
Q < T, 
frequency interval T, <Q<3 T also maps into the interval -t < œ < m 
and, in general, so does the interval (2k — Dr <Q< Qk+ Dr, when k is an 
integer. This means that the mapping from the analog frequency Q to the frequency 


maps into the corresponding values of —z < œ < a. Furthermore, the 


variable œ in the digital domain is many-to-one, which reflects the effect of aliasing 
due to sampling. Figure 14.18 illustrates this. 


Figure 14.18. The mapping in impulse invariance method. 
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To explore further the effect of the impulse invariance method on the charac- 
teristics of the resulting filter, let us express the system function of the analog filter 
in partial fraction form. On the assumption that the poles of the analog filter are 


distinct, we can write 


Ha(s)= >, (14.111) 
where, p;’s are the poles of the analog filter and c,’s are the residues. Hence, 


N 
halt) = ce, t>0. (14.112) 
k=1 


If we sample hq (t) periodically at t = nT;, we have 


hin] = ha(nT;) 


= > one? (14.113) 


Now with the substitution of Eq. (14.113), the system function of the resulting 
digital IIR filter becomes, 


H(z) = Slhink™ 


n=0 
cau n 
=$) (erte) (14.114) 
k=1 n=0 


The inner sum in Eq. (14.114) converges because pg < 0 and yields 
= 1 
PkIs„—1 
È (e Z = (oe (14.115) 


n=0 


Therefore the system function of the digital filter is 


N 
H(z) = a ra ae (14.116) 


The poles of the digital filter is 


z =e, k=1,2,..., N. (14.117) 
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Although the poles are mapped according to Eq. (14.117), the zeros in the two 


domains do not satisfy the same relationship. Therefore the impulse invariance 


method does not correspond to the simple mapping of the points given by z = e°®. 


14.3.31 Design Procedure 


Given the filter specifications (wp, @s, etc.), we have to follow the following steps: 


e Choose T, and determine the analog frequencies 


2p 


Q, = 14.118 
PET, ( ) 
and 
Ws 
O= 14.11 
E7, ( 9) 


e Design an analog filter H,(s) using the specifications (Butterworth, 
Chebyschey, or elliptic). 
e Using partial fraction approach, find 


N 
Ha(s) = >, —* (14.120) 
rai” Pk 
e Transform the analog poles px into digital poles e?! to obtain the digital 
filter 
N Ck 
H(z) = Pees e (14.121) 
k=1 
Example: Transform Hy(s) = wt into a digital filter using the impulse invari- 
ant technique in which T; = 0.1. 
We have 
s+1 2 1 
H,(s) = = — , 14.122 
als) s? +5s+6 s+3 s+2 ) 
by partial fraction approach. 
Poles are pı = —3 and p2 = —2. We get H (z) as 
2 1 
M= l—e3hz-1 1 —e-2hz-1 
1 — 0.896627! 
(14.123) 


~ 7 — 1,5595z-! + 0.60652~2 
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Note: The advantages of the impulse invariant mapping are that it is a stable design 
and that frequencies Q and @ are linearly related (@ = QT;). But the disadvantage 
is that we should expect some aliasing of the analog frequency response, and in 
some cases this aliasing is unacceptable. Hence, this design method is useful only 
when the analog filter is essentially band-limited to a low-pass or band-pass filter. 


14.3.4 IIR Filter Design by the Bilinear Transformation 


The two methods ((i) method of approximation of derivatives and (ii) the impulse 
invariance method) of the IR filter designs discussed have severe limitation in that 
they are appropriate only for low-pass filters and a limited class of band-pass filters. 
The bilinear method overcomes this limitation. 


e The bilinear transformation is a conformal mapping that transforms the jQ- 
axis onto the unit circle in the z-domain only once, thus avoiding the aliasing 
of frequency components. 

e All points in the LHP of the s-plane are mapped inside the unit circle and 
all points in the RHP of the s-plane are mapped into corresponding points 
outside the unit circle in the z-plane. 

e This method preserves the system function representation as well. 


Let us consider an analog linear filter with system function 


b 
H (s) = 14.124 
(s) TF ( ) 
This system is also characterized by the differential equation 
dy(t 
oo + ay(t) = bx(t). (14.125) 


Instead of using the difference equation approach, suppose that we integrate the 
derivative and approximate the integral by the trapezoidal formula [9]. Thus 


t 
y(t) = J y’ (t)dt + y(to), (14.126) 
J t0 


where y’(t) denotes the Ist derivative of y(t). By applying the trapezoidal formula 
at t = nT; and to = nT; — Ts, the approximation of Eq. (14.126) becomes 


Ts $ / 
y(nT;) = 30 ATs) + y (nT, — Ts)] + yT; — T;). (14.127) 
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Now the differential equation in (14.125) evaluated at t = nT, yields 
yT) = —ay(nTy) + bx(nTy). (14.128) 


We use Eq. (14.128) to substitute for the derivative in Eq. (14.127) and thus 
obtain a difference equation for the equivalent discrete-time system. With y[n] = 
y(nT;) and x[n] = x(nTs), we get 


(1+) int - (1- ) m=i _ bT; 1 
z pole 5 pr ] = — Gl] + x[n - 1) 


(14.129) 


The z-transform of this difference equation is 


Hence, the system function of the equivalent digital filter is 


bTs -1 
Y(z) (4) (+<"") 
H(z) = = (14.131) 
TO EEDE 
or, equivalently 
H(z) = (14.132) 


Comparing Eqs. (14.124) and (14.132), we get the mapping from s-plane to 
the z-plane as 


2 (1-z! 
=+) (14.133) 


This is called the bilinear transformation. 


14.3.4.1 Characteristics of the bilinear transformation 


To investigate the characteristics of the transformation, let z = re/® ands = 
o + jQ. Then Eq. (14.133) can be expressed as 


2 ( r?—1 i 2r sin œ (14.134) 
s= ; 
T, \ 1 +r2+2r coso EFT 
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From this, we get, 


2 r?—1 
= : 14.135 
’ = (aes) ( ) 
2 2r sin œ 
Q= : 14.136 
= (aes) i ) 


From these equations, we note that ifr < 1,theno < 0,andifr > 1,theno > 0. 
Hence, the LHP in s-plane maps into the interior of the unit circle in the z-plane 
and the RHP in s-plane maps to the outside of the unit circle. When r = 1, then 
o = Qand 


2 sin @ 

Q9 = — | — 14.1 
T; (, + cos -) ( a 
2 o 

= Fn (5) (14.138) 
or, equivalently 
QT, 
@ = 2 tan”! ( 5 ) (14.139) 


This relationship between the frequency variables in the two domains is called 
“frequency warping” and is illustrated in Fig. 14.19. We observe that the entire 
range in Q is mapped only once into the range -m < œ < m. However, the 
mapping is highly non-linear. We observe a frequency compression or frequency 
warping due to the non-linearity of the arctangent function. It is also interesting 
to note that the bilinear transformation maps the point s = oo into the point 
z = —1. Consequently, the single-pole low-pass filter in Eq. (14.124), which has a 
zero at $ = OQ, results in a digital filter that has a zero at z = —1. 


14.3.4.2 Consequences of Frequency Warping 


It is easy to verify that the bilinear transform gives a one-to-one, order-preserving, 
conformal mapping between the analog frequency axis s = jQ and the digital 


—— | 
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Figure 14.19. Relation between øw and Q in bilinear transformation. 
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frequency axis z = e/®1s , where T; is the sampling interval. Therefore, the ampli- 
tude response takes on exactly the same values over both frequency axes, with the 
only problem being a frequency warping such that equal increments along the unit 
circle in the z-plane correspond to larger and larger bandwidths along the jQ axis 
in the s-plane. The frequency warping is certainly unavoidable in any one-to-one 
map because the analog frequency axis (jQ) is infinite while the digital frequency 
axis (unit circle) is finite. The relation between the analog and digital frequency 
axes can be seen in Figs.14.19 and 14.20 as well as in the following equations. 


Q, = tan (2). (14.140) 
and 
Q, = Zuan (F) (14.141) 


This is illustrated in Fig 14.20 below. 
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Figure 14.20. Consequence of frequency warping. 
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Here, the good news is that we do not have to worry about frequency aliasing. 
On the other hand, the bad news is that we have to account for frequency warping 
when we start from a discrete-time (digital) filter specification. 


14.3.4.3 Design Procedure 


Given the filter specifications (@p, @s, etc.), to design the digital filter, we have the 
following steps: 


e Choose T; (usually set as 1) and determine the analog frequencies 


Q, = Z an (2) (14.142) 
and 
Q, = Zan (>) (14.143) 


e Design an analog filter Ha(s) using the specifications (Butterworth, 
Chebyschev, or Elliptic) to meet the specifications. 
e Finally, set 


21-27! 
A(z) = Ha | = 14.144 
() (tr) (14.144) 
Example: Transform H4 (s) = with into a digital filter using the bilinear trans- 


formation technique. Choose T; = 1. 
Using the transformation, we have 


2 tae 
H(z) = H,{ — —— (14.145) 
G 1+2z l _) 
1- —1 
= Hy (2; =) (14.146) 
gi-z 41 
= laser (14.147) 


Simplifying, 


3422 '-z7?  0.154+0.12~! — 0.0527? 


= 14.148 
20 + 4z7! 1 + 0.2z7! : 
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Once H(z) is obtained, all the analysis, as well as its implementation schemes 


of the filter can be performed. 


14.4 Concluding Remarks 


In this chapter, the most commonly used methods for the design of both FIR and 


IR filters were discussed in detail. They are: 


e For the design of FIR filters 
— Windowing method, 


— Frequency sampling method, and 


— Optimization method. 
e For IIR Filters 


— Approximation of derivatives method, 


— Impulse invariance method, and 


— Bilinear transformation method. 


Exercises 


14.1. This problem deals with the design of IIR (infinite impulse response) dig- 


ital filter from respective analog filter whose transfer function is given as 


S 


H = 
(8) = Sy 400s #2 x 105 


where s = ø + jQ is the Laplace variable. 


(a) 


(b) 


Using the method of approximation of derivatives, design a digital 
IIR filter (that is, determine the system function H (z) and the corre- 
sponding difference equation relating the input, x[n] and the output, 
y[n] of the filter) to simulate the analog filter given by H (s) above. 
Use a sampling rate of 1 kHz (that is, fs = 1000). 

Using the method of bilinear transformation, design a digital IIR fil- 
ter (that is, determine the system function H (z) and the correspond- 
ing difference equation relating the input, x[n] and the output, y[7] 
of the filter) to simulate the analog filter given by H(s) above. Use 
the same sampling rate of f; = 1000 here as well. 

Compare and comment on the IIR system functions derived using 
these two methods. 
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14.2. Use the frequency sampling method to design an FIR filter whose fre- 
quency responses goes through the points as given in table below: 


k 012345 6 7 
H(e*) 0 1 jooo -j 1 


14.3. Using bilinear transformation, design a digital low-pass Butterworth filter 
with a 3dB cut-off frequency of 2kHz and minimum attenuation of 30dB 
at 4.25kHz for a sampling rate of 10kHz. 


DOT: 10.1561/9781680839791.ch15 


Chapter 15 


Random Signals 


The type of signals that we have been dealing with in the previous chapters are deter- 
ministic in nature, i.e., signals which may be described by mathematical expressions 


and whose behaviour does not contain any uncertainty or randomness. Typical 
examples of deterministic signals are 2 cos(1007 t +7 /4), u(t —2), 6(t) —d(t—5), 
e~ u(t), e74, ete. 

In this chapter, we study the class of signals known as random signals. Unlike 
deterministic signals, the random signals have some randomness or uncertainty asso- 


ciated with them. The study of random signals is very important since many of the 


signals in the real world are random in nature. 


In this chapter, the following points are discussed in detail. 


What causes randomness in signals? 

How to characterize or describe random signals? 

Meaning of statistics (or, averages) such as mean, variance, power, correlation, 
power spectrum, etc. 

Linear filtering of random signals. 

Concept of white noise. 
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15.1 Introduction 


In engineering, we often encounter signals that do not have a precise mathemat- 
ical description, since they develop as random functions of time. Sometimes this 
random behaviour may be caused by a single variable, but often it is the conse- 
quence of interactions of many random variables. An example is the thermal noise 
which is generated by the random movement of electrons in an electric conductor. 
Another example would be the response of brain cells (neurons) to external stim- 
ulus, like auditory/visual/tactile, etc. In other cases, the causes of randomness are 
not clear and a description is not possible, but the signal is characterized by means 
of measurements only. 

A random time function may be a desired signal (information), such as an audio 
or video signal, or it may be an unwanted signal that is unintentionally added to a 
desired signal and disturbs the desired signal. The desired signal can be considered 
as a random signal and the unwanted signal the noise. However, the latter often 
does not behave like noise in the classical sense, but it is more like interference. 
This means that it is an information bearing signal but undesired. In all cases, a 
description of the signals is required in order to be able to analyse its impact on 
the performance of the system under study. The random character as a function of 
time makes the signals difficult to describe and the same hold for signal processing 
or filtering. Nevertheless, there is a need for characterizing these signals by a few 
deterministic parameters that enable the system to assess the performance of the 
system. 

Consider the following examples of random signals: 


e The signals received by the antenna in a radio/TV receiver is the transmitted 
signal mixed with noise, where the noise is random in nature. 

e When we speak into a microphone, the signal that enters the microphone is 
not only our speech but also the random noise that is present in the acoustic 
environment. 

e Ifyou say your name several times, the speech signal that you produce each 
time is not exactly the same. There is some randomness associated with the 
speech production mechanism in your vocal tract, even though we hear you 
saying the same name again and again. 

e The output of a sinusoidal signal generator is given by 


x(t) = Acos(2a fot + 0). (15.1) 


The amplitude A and frequency fo can be set by us and are hence determinis- 
tic. On the other hand, the phase @ is random and it can be anywhere in the 
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interval [0, 27]. Each time we switch on the signal generator, the starting 
phase of the signal is different and unpredictable. This randomness in the 
phase makes x (t) a random signal. 


Thus, there is a lot of randomness in the real world around us. 


15.2 Stochastic Process 


In probability theory, a random variable x is a rule that assigns a number to every 
outcome of an experiment, such as, for example, rolling a die. This random variable 
is associated with a sample space S, such that according to a well-defined procedure 
to each event s in the sample space, a number is assigned to x and is denoted by 
x(s). For stochastic process, on the other hand, a time function x(t, s) is assigned 
to every outcome in the sample space. Within the framework of the experiment, the 
family (or ensemble) ofall possible functions that can be realized is called a stochastic 
process. A specific realization out of this family is denoted as x, (t) and is called a 
sample function of the stochastic process. In general, the subscript n is omitted in 
representing a sample function. Figure 15.1 shows a few sample functions that are 
supposed to form an ensemble. 


Tn+2(t) 


Tn+1(t) 


talt) 


En—1(t) 
| R 
a(t) 


Figure 15.1. A few sample functions of a stochastic process. 


330 Random Signals 


This figure gives an example of a finite number of possible realizations, but an 
ensemble may consist of infinite number of realizations. A stochastic process pro- 
duces a random variable that arises from giving t, a fixed value with s being variable. 
This means that the random variable x(t), s) = x(t1) is found by considering the 
family of realizations at the fixed point in time tı (see Fig. 15.1). Instead of x (t1) we 
may use the notation x1. The random variable xı describes the statistical properties 
of the process at the instant of time t1. The expectation of xı (denoted as E[x;]) is 
called the ensemble mean or the expected value or the mean of the stochastic process 
(at the instant of time t1). Since tı is an arbitrarily chosen time, the mean of the 
process will in general may not be same, i.e., it may have different values at differ- 
ent time instances. Finally, a stochastic process may represent a single number by 
giving both ¢ and s fixed values. 

The phrase stochastic process may therefore have four different interpreta- 
tions as: 


A family (or ensemble) of time functions. Both ¢ and s are variables. 


A single time function called a sample function or a realization of the stochas- 
tic process. Then ź is a variable and s is fixed. 


A random variable; t is fixed and s is variable. 


A single number; both ¢ and s are fixed. 


Different classes of stochastic processes may be distinguished. They are classified 
on the basis of the characteristics of the realization values of the process x and the 
time parameter t. Both can be either continuous or discrete, in any combination. 
Then we have the following four classes: 


e Continuous stochastic process: Both the values of x(t) and ¢ are continuous. 

e Discrete-time processes: The values of x(t) are continuous, whereas time f is 
discrete. These processes are also called continuous random sequences. 

e Discrete stochastic processes: Here the values of x(t) are discrete but the time 
axis is continuous. 

e Discrete random sequence: Both the values of x(t) and t are discrete. 


15.2.1 Continuous Stochastic Processes 


For this class of processes, it is assumed that in principle the following holds: 
—0o < x(t)<œ and -=œ <t <œ (15.2) 


An example of this class is already given by Figure 15.1. This could be an ensem- 
ble of realizations of a thermal noise process produced by a resistor. 
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Figure 15.2. Ensemble of sample functions of the stochastic process A cos(2z fot + 8), with 
6 uniformly distributed in the interval (0, 27]. 


Another example is the process described by the following equation: 
x(t) = Acos(2z fot + 0). (15.3) 


with A, and fo constant and @ a random variable with a uniform probability density 
function on the interval (0, 27]. In this example, the number of realizations is in 
fact uncountable, as 0 assumes continuous values. An ensemble of sample functions 
is shown in Fig. 15.2. 


15.2.2 Discrete-Time Processes (Continuous Random 
Sequences) 


As an example of this type of process, we can imagine sampling the process that is 
shown in Fig. 15.1. Let us suppose that to this process ideal sampling is applied at 
equidistant points in time with sampling period T, (the ideal sampling means that 
the values at Ts are replaced by delta functions of amplitude x(nT;)). The process 
that is produced in this way is shown in Fig. 15.3, where the sample values are 
presented by means of the length of the samples. 

Another important example of the discrete-time process is the so-called Poisson 
process, where there are no equidistant samples in time but the processes produce 
samples at random points in time. 


332 Random Signals 


Figure 15.3. Example of a discrete-time stochastic process. 
15.2.3 Discrete Stochastic Processes 


Two examples are presented here: 


Example 1: The ensemble or realizations consists of a set of constant time func- 
tions. According to the outcome of an experiment, one of these constants may be 
chosen. This experiment can be, for example, the rolling of a die. In this case, the 
number of realizations can be six (n = 6), equal to the number of faces of a die. 
Each of the outcomes, s € {1, 2,3, 4,5, 6} has a one-to-one correspondence to 
one of these numbered constant functions of time. The ensemble is depicted in 
Fig. 15.4. 


Example 2: Another important stochastic process is the random data (bits) signal. 
It is produced by many data sources and is described by 


x(t) = >) Anp(t — nT — $). (15.4) 


where {An} are the data bits that are randomly chosen from the set A, € {+1, —1}. 
The rectangular pulse p(t) of width T serves as the carrier of the information. 
Now ¢ is supposed to be uniformly distributed in the bit interval (0, T], so that 
all data sources of the family have the same bit period, but these periods are not 
synchronized. The ensemble is shown in Fig. 15.5. 
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Figure 15.4. Ensemble of sample functions of the stochastic process constituted by a 


number of constant time functions. 
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Figure 15.5. Ensemble of sample functions of the stochastic process x(t) = >7,, Anp(t — 


nT — ¢), with ¢ uniformly distributed in the interval (0, T]. 
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Figure 15.6. Example of a discrete random sequence. 


15.2.4 Discrete Random Sequences 


The discrete random sequence can be imagined to result from sampling a discrete 
stochastic process. Figure 15.6 shows the result of sampling the random data signal 
from Example 2. 


15.3 Deterministic Function vs Stochastic Process 


The concept of the stochastic process does not conflict with the theory of deter- 
ministic functions. It should be recognized that a deterministic function can be 
considered as a special case of a stochastic process. This is elucidated by consider- 
ing the example given in Eq. (15.3). Ifthe random variable @ is given the probability 
density function f9(@) = 6(@), then the stochastic process reduces to the function 
cos(2z fot). The given probability density function is actually a discrete one with 
a single outcome. 

In fact, the ensemble of the process reduces in this case to a family comprising 
merely one member. This is a general rule; when the probability density function of 
a stochastic process that is governed by a single random variable consists of a single 
delta function, then a deterministic function results. This way of generalization 
avoids the often confusing discussion on the difference between a deterministic 
function on the one hand and a stochastic process on the other hand. In view of 
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the consideration presented here, they can actually be considered as members of 
the same class, namely the class of stochastic process. 

The random processes are characterized by statistical measures, which are 
described in the following sections. 


15.4 Probability, Cumulative Distribution Function 
and Probability Density Function 


The set of possible outcomes of a random experiment is called the sample space. An 
element in the sample space is called a sample point. Each outcome of a random 
experiment corresponds to a sample point. Subset of the sample space are called 
events, and events consisting of a single element (sample point) are called elemen- 
tary events. 

Probability is a number, associated with the events according to some appropriate 
probability law. The probability assigned to the event s from the sample space S 
(s € S) is denoted as P(s) and has a value between 0 and 1 (0 < P(s) < 1). 
In order to be a valid probability assignment, the following three axioms must be 
satisfied: 


e P(s) > 0 for every events € S. 
e P(s) = Q for the certain event S. 
e For any two mutually exclusive events 5; and s2, P(s;Us2) = P(s1)+P(s2). 


In signal processing applications, it is the probabilistic description of the random 
variable, rather than the statistical characterization of events in the sample space, 
that is generally of interest. It is therefore more convenient to have a probability 
law assigned to the random variable itself. For a fixed value of the time parameter 
(say t1), the cumulative probability distribution function (CDE) or, for short, the 
distribution function of the random variable x, is defined by 


Fy (x13 t1) £ P{x(t) < x1}. (15.5) 


From this notation, it follows that Fy may be a function of the value of tı that 
has been chosen. 

For two random variables x1 = x(t1) and x2 = x(t2), the 2nd order joint 
probability distribution function can be derived as the two-dimensional extension 
of the the above equation as follows: 


Fy (x1, x2; t1, t2) £ P{x(t1) < x1, x (t2) < x2}. (15.6) 


336 Random Signals 


Similarly, this can be extended to the N*”-order joint cumulative probability 
distribution function as 


Fy (xq,...,XN3 t,...,tNn) A P{x(t1) < x1,...,x(ty) < xy}. (15.7) 


The corresponding (joint) probability density functions (PDF) are found by taking 
the derivatives respectively of the above equations as shown below: 


A ôF, (x1; t1) 


fe; 1) = (15.8) 
Ox] 
O72 Fy (x X2; t,t 
ona Se (15.9) 
0x1 0x2 
OP Fe Oia wccs XN; tls... t 
AC ae t... ty) È x1 ANa N) (15.10) 


Ox1,...,O0XN 


Statistical Independence: Two processes x (t) and y(t) are called statistically inde- 


pendent if the set of random variables {x (t1), x(t2), ..., x (tn)} is independent of 
the set of random variables {y(t;), y(t), ..., y(th,)}, for each arbitrary choice of 
the time parameters {t1 , t2, .. . , tN; ti, th, ..., thy}. Independence implies that the 
joint probability density function can be factored in the following way 


fey Cees i Pg ee Tcl) 
= f&s- XN5 tis ekg EN) fy O1 oo YM; fio -> fy). (15.11) 


Thus, the joint probability density function of two independent processes is 
written as the product of the two marginal probability density functions. 


15.5 Description of Random Signals 


One of the main issues in the study of random signals is: how to describe or char- 
acterize random signals? This problem arises because of the randomness associated 
with such signals. For example, if the speech signal you produce is different each 
time you speak your name, how can we present a single waveform as the signal cor- 
responding to your name? Each record of the signal is similar to one another, and 
yet different, with some unpredictable variability associated with each record. So, 
we may consider taking an average of several records and present that as the speech 
signal corresponding to your name. 

Consider another example of waiting to board a bus that is scheduled to arrive 
at 8.30a.m. daily. If we keep track of the exact arrival time of the bus each day, we 
will find that there is some amount of variability associated with the arrival time. 
If we observe the arrival pattern of the bus for several days, we can estimate the 
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average arrival time and the associated variability (e.g., +3 minute, +30 seconds, 
etc. with respect to the average). The variability in the arrival time depends on many 
factors such as drivers mood, condition of the bus, weather, traffic flow etc. These 
factors are clearly random in nature and these give rise to the randomness in the 
arrival time of the bus. In summary, we can say the following. 


§ Associated with every random signal, there are some physical phenomena which cause 
randomness. While these physical phenomena may not be observable, what we can observe 


and measure are the effects causes by them, which are the random signals. 


The above examples show that we have to use averages to characterize the features 
of random signals. Averages are also called statistics. Just as we need to observe the 
arrival time on several days for estimating the average arrival time, we need to observe 
several copies of a random signal before we can estimate the averages associated with it. 

Two of the most commonly used statistical averages are mean and correlation, 
which are the first and the second order statistics, respectively, of a random process. 
In practical applications, very often, these two averages are sufficient to make con- 
clusions or assessments about the observed random signals. So, we will look into 
the definition and meaning of these averages. 


© Mean of a Random Process: This is the most simple of all the averages. Let x (t) 
be an analog random signal. Its mean, denoted by mx, is the average value of 
x(t) and is given by 


mx = E[x(t)] = [sfc t)dx, (15.12) 


C 


where f(x; t) is the PDF of the random variable x(t), E[-] denotes the sta- 
tistical expectation operator, and c defines the complete range of the random 
variable x(t). Observe that the mean may be a function of the time index t. 


Linearity of Mean: It is easy to verify from Eq. (15.12) that mean is a linear 


operator. If x(t) and y(t) are two random signals, then for any two scalars a 
and f, 


E [ax(t) + Lyt) = aE [x0] + BE DO]. (15.13) 


Thus, the mean of a linear combination of signals is equal to the same linear 
combination of the means of the respective signals. 

© Auto correlation of a Random Process: The autocorrelation function (ACF) of 
a stochastic process is defined as the correlation E[x1x2] of the two random 
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variables xj = x (t1) and x2 = x (t2). It is defined as 


manana = f | eee pide 
(15.14) 


where fx(x1, x2; t1, t2) is the joint PDF of the random variables xı and x2. 
Observe that the autocorrelation may be a function of the time indices ty 
and fo. 

Substituting t1 = t and h = tı + 7, Eq. (15.14) becomes 


V(t +t) = Ef[x(t)x* (t + 5). (15.15) 


© Cyross-correlation function (CCF) between two random processes: It is defined as 


Yxy(t, t +T) = Elx@y"¢ +7). (15.16) 
§ Prove the following: 
Yxx (t2, t1) = Vey (1, t2) (15.17) 


15.6 Stationary Processes 


We can say that a stochastic process is stationary if its statistical properties do not 
depend on the time parameter. There are several types of stationarity like strict-sense 
stationarity, wide-sense stationarity, etc. 


15.6.1 First-Order Stationary Processes 


A stochastic process is called first-order stationary process if the first-order PDF is 
independent of time. That is, 


fx (013 t1) = fr tı + T) (15.19) 


holds for all values of t. As a result of this property, the mean my of such process 
is constant (i.e., it is independent of time). 


15.6.2 Second-Order Stationary Processes 


A stochastic process is called second-order stationary process if the two-dimensional 
PDF 


Fx 1, x2; ti, t2) = fs 1, x2; ti + T, t2 + T), (15.20) 
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for all values of T. It is easy to verify that the above equation is only a function of the 
time difference t2 — tı and does not depend on the absolute time. In order to gain 
that insight, put t = —f,. A process that is second-order stationary is first-order 
stationary as well, since the second-order joint PDF uniquely determines the lower 
order (first-order in this case) PDE 


15.6.3 N‘'-Order Stationary Processes 


By extending the reasoning from the last subsection to N random variables, we 
arrive at the N*}-order stationary process. For such processes, the N“'-order joint 
PDF is independent of time shift. i.e., 


Fx 1,---,XN3t1,..-5tN) = fx(X1,..., XN; t1 +T,... tN +7) (15.21) 


for all values of t. Such processes are stationary for all orders k < N. An N*”-order 
stationary process where N can have an arbitrary large value is called a strict-sense 
stationary process. A random process {x(t)} is said to be stationary in the strict-sense 
if all of its statistical averages or characteristics do not change with a shift in the 
time origin. That is, the joint PDF of {x(t1), x(t2), ..., x(ty)} depends only on 
the differences between the time indices {t1, t2, . . . , ty} and not on the actual value 
of each index. 


15.6.4 Wide-Sense Stationary (WSS) Processes 


Since the two-dimensional joint PDF for a second-order stationary process depends 
only on the time difference (t = t — tı), the autocorrelation function will also be 
a function of the difference t. Then Eq. (15.15) can be written as 


Yux(t,t +7) = yx (7). (15.22) 


The mean and the autocorrelation function of a stochastic process are often the 
most important characterizing features. It becomes easier if these two quantities 
do not change in absolute time. A second order stationary process guarantees this 
independence butat the same time places severe demands on the process. Therefore, 
we define a broader class of stochastic process, the so called wide sense stationary 
process. So, a random process {x(t)} is said to be stationary in the wide-sense (or, 
weakly stationary) if its mean and autocorrelation do not change with a shift in the 
time origin. That is, it satisfies the following conditions: 


E[x(t)] = mx = constant (15.23) 
E[x(t)x(t + t)] = yxx(t). (15.24) 
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It is clear that a second-order stationary process is also wide-sense stationary. The converse, 


however, is not necessarily true. 
15.6.5 Jointly WSS Random Processes 


The random processes {x(t)} and {y(t)} are said to be jointly stationary in the wide 
sense if they are individually WSS and their cross-correlation yxy (t, t + t) depends 
only on T not on the absolute time parameter. Therefore, we have 


Yxy(t,t +7) = E[x(t)y(t + t)] = yxy(t). (15.25) 


15.6.6 Properties of yxx(T) 


Ifa process is at least WSS, its autocorrelation function exhibits the following prop- 
erties: 


© |yex(t)| < yxx(0). This means that |yxx(T)| attains its maximum value 
when t = 0. 
To prove this property, let us consider the expression 


El{x(t) + x(t +7)}7] = EKE +x +r) £ 2x(t)x(t + 7)] 
= 2{Yxx (0) ar Yxx(T)} (15.26) 


Since the expectation E[{x (t) +x (t + t}?] is taken over the squared value of 
a certain random variable, this expectation should be > 0. Thus the proof. 
e Symmetry property (yxx(—T) = Yxx(T)). i.e., Yxx(T) is an even function 
oft. 
To prove this property, substitute t’ = t + t in the definition of the 
autocorrelation function. Then, 


Yxx (1) = Elx (tx + 1)] = Elz’ — t)x(t’)] 
= E[x(t’)x@ — t)] = yxx(-7) (15.27) 
e yxx(0) = E[x?(t)] = o2 +m?. This property follows immediately from the 


definition of yxx (T) by inserting t = 0 (Eq. (15.24)). It may also be noted 
that 


xx (0) = E[x?(t)] = px = of + m?, (15.28) 


where px is the power of the random process x (t). o2 is the variance. 
e If x(t) has no periodic component, then y,,(t) comprises a constant term 
which is equal to E[x(t)[’. i.e., limito Yxx(t) = E[x(t)]? = m. 
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Figure 15.7. Example of an ACF. 


Proof: From a physical point of view, most processes have the property that 
the random variables x(t) and x(t + 7) are independent when tT —> oo. 
From the definition of the autocorrelation, it follows that 


lim ue(t) = lim Elx(x(e + 1) 
Elx(QlElx(t + 1)] 
=mym, = m? (15.29) 


Figure 15.7 shows a typical ACF with the properties just discussed. The 
negative values of the ACF in this figure show that for these values, the shift 
t of the expected value E{x(t + t)x(t)} is negative. It means that with a 
separation T, x(t + T) and x(t) are expected to have opposite signs. Like 
large positive values of the ACF, large negative values also indicate a strong 
relationship between the values of x(t). The lower bound, —o2 + m2 is not 
reached in this example. The properties such as the maximum value of the 
ACF, lower bound and the symmetry hold for all stationary random signals. 
The uncorrelation at very high values of t holds when distantly separated 
values do not correlate. 

e Ifx(t) hasa periodic component, then yxx(T) will comprise a periodic com- 
ponent as well, and which has the same periodicity. 


Proof: Periodic processes may be decomposed into cosine and sine compo- 
nents according to the Fourier analysis. It therefore suffices to consider the 
autocorrelation function of one such component: 


E[cos(wt — 0) cos(@t + wt — 0)] = 5Eleos(or) + cos(2@t + wt — 20)] 
(15.30) 


Since our considerations are limited to WSS, the autocorrelation function 
should be independent of the absolute time t, and thus the expectation of the 
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Figure 15.8. Typical ECG waveform (a) and its ACF (biased estimate) (b). 


last term of the latter expression should be zero. Thus only the term compris- 
ing cos(@t ) remains after taking the expectation, which proves this property. 


Figure 15.8 shows an example ECG waveform (Fig. 15.8(a)) for 10 seconds and 
its corresponding ACF (estimated) (Fig. 15.8(b)). It can be seen that the maximum 
of the ACF happens at t = 0. Because of the repetitive (not exactly periodic) 
nature of the ECG waveforms, the ACF also shows some kind of repetitiveness. 
The Matlab function xcorr is used to find a biased estimate of the ACF of the 
ECG signal. 


15.6.7 Properties of yx (z) 
If two processes x(t) and y(t) are jointly WSS, then the cross-correlation function 
exhibits the following properties: 

© yxy(—T) = yyx(t). 


Proof: In the definition of the cross-correlation function, replace t — t by t’ 
and after some manipulations, we get 


Yxy (=T) = Elx()y@ — 1)] = Ele’ + 2)y@’)] 
= Ely(t)x(’ +t))= Yyx(T) (15.31) 
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i lyxy(t)| < y Yxx(0)yyy (0). 


To prove this property, we consider the expectation of the process {x (t) + 
cy(t + t), where c is a constant; i.e., we investigate 


Elx (E) + ey(t + t)}°] = ELX] = yx (0) + c°yyy (0) + 2c7xy(1). 
(15.32) 
where 
E[X] = E[x?(t) + cy? + 1) + 2cx(Ny(t + 1)], 
= E[x*()] + Ely? t + 1)] + 2cELx(@) y(t + 1)]. 
(15.33) 


This latter expression is a quadratic form in c, and since it is the expecta- 
tion of a quantity squared, this quantity can never be less than 0. As a result, 
the discriminant cannot be positive; i.e., 


y2,(©) — yxx(O)yyy(0) < 0. (15.34) 


Iyxy(Z)I < ,/Yxx(0)yyy (0). (15.35) 


© lyxy(t)| < slyxx (0) + Yyy(0)]. 


Proof: This property is a consequence of the well-known fact that the arith- 


This implies that, 


metic mean of two positive numbers is always greater than or equal to their 
geometric mean. 


Example: Based on the correlation function, it is possible to measure the distance of 
an object from a transmitter. This example explains the scheme in detail. Consider 
the system shown in Fig. 15.9 where a signal source produces a random signal, being 
a realization of a stochastic process. Let us assume that the process is WSS. The 
signal is applied to a transmitter that produces a wave in a transmission medium; 
let it be an acoustic wave or an electromagnetic wave denoted by x (t). Let us further 
assume that the transmitted wave strikes a distant object which reflects (partly) the 
wave. Then the reflected wave will travel backwards to the position of the measuring 
equipment. The receiver at the measuring equipment receives this signal, denoted 
as y(t). These signals x(t) and y(t) can be applied to a correlator that estimates 
the cross-correlation function yxy(T) given by, 


Yxy(t) = E[x(t)y@¢ + 1)] = Elx@ax(t —T +1)] = ayyx(t — T) 
(15.36) 
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Figure 15.9. Set up for measuring a distance based on the correlation function. 
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Figure 15.10. (a) The autocorrelation function of the transmitted signal x(t) and (b) 
the measured cross-correlation function (between the transmitted signal, x(t) and the 
received signal, y(t)) of the distance measuring set up. 


where y(t) = ax(t—T) is the delayed and attenuated version of x(t), T is the total 
travel time. Figure 15.10 shows the autocorrelation and cross-correlation functions. 
We will be able to estimate the distance (d) of the object from the transmitter if 
we know the propagation velocity (v) of the wave in the medium and the time, T 
using the relation, 2d = v x T, where 2d is the distance travelled during the time 
period of T units. 


15.6.8 Independent, Uncorrelated, and Orthogonal Processes 


The random processes {x (t)} and {y(t)} are said to be 


e Independent if the random variables {x (t1), x(t2), ...,x(tm)} are mutually 
independent’ of the random variables Y), y(t), ees y(t,,)} for all m. 
© Uncorrelated if E[x(t)y(t + t)] = mx.my for all t and t. 


1. The set of random variables x1, x2, ..., Xm are said to be independent if their joint PDF is separable. That 


is, Soy x9---Xm (41, X25... 3 Xm) = tr, (x1) fa (x2) ++ Sem (Xm). 


Physical Interpretation of Process Parameters 345 


© Orthogonal if yxy(t,t +7) =O forall t and ct. 
Thus, zero-mean orthogonal processes are also uncorrelated. 


§ Examine why independent processes are also uncorrelated, while uncorrelated processes 
need not be independent. 


15.6.9 Covariance Functions 


Correlations of random processes after removing the mean are called covariances. 
For stationary processes, the auto- and cross-covariances are given by 


Cyx(t) =E KELO) mx)(x(t +t)—m,)|= Yxx(T) = m?. (15.37) 

Cxy(T) =E [e0 —m,)(y(t + T) my)| =< Yxy(t) — MxMy. (15.38) 
For random signals, the signal samples become less correlated as they become more 
and more separated in time. Therefore, 


lim yxx(t)=m2 => lim Cyx(t)=0, (15.39) 
TCO TCO 
provided the process x(t) does not have a periodic component. 
The symmetry properties of correlation and covariance functions are useful in 
signal analysis: 


Yxx(T) = Yux(—T), Cyxx(t) = Cxx(—1) (15.40) 
Yxy(T) = Yyx(-T), Cxy(t) = Cyx(-T). (15.41) 
Further (when t = 0), 
yxx(0) = E [KOP] = px (15.42) 
Cyx(0) = E [ixo = mxl] =o? (15.43) 
lyxx(t)| < Yxx(0) forall z. (15.44) 


where, py is the average power of x(t). Note that a? is the variance of x(t). When 
the mean of the random process is zero, the correlation functions are same as the 
covariance functions. 


15.7 Physical Interpretation of Process Parameters 


In the previous sections, stochastic processes have been described from a mathe- 
matical point of view. In practice, we want to relate these descriptions to physical 


346 Random Signals 


concepts such as signal, represented, for example, by a voltage or a current. In these 
cases, the following physical interpretations are connected to the parameters of the 
stochastic processes: 


e The mean my = E[x(t)] is proportional to the d.c. component of the signal 

e The squared mean value m? = {E[x(t)]}* is proportional to the power in 
the d.c. component (px(pc)) of the signal. 

e The mean squared value E[x7(t)] is proportional to the total average power 
of the signal. 

e The variance o2 = E[x*(t)] — m2 is proportional to the power in the time 
varying components of the signal, i.e., the a.c. power. 

e The standard deviation ox is the square root of the mean squared value of the 
time-varying components, i.e., the root-mean-square (r.m.s) value. 


15.8 Gaussian Random Processes 


We will now briefly describe some properties of Gaussian? random processes which 
are very useful in the study of signal processing and communication systems. 


Definition: The (real-valued) process {x(t)} is said to be a Gaussian process if it 
has the following PDF: 


(x = mx)? 
pes = |- oo], (15.45) 


202 


1 
Ox N 2T 


When considering two jointly Gaussian random variables x and y, the joint PDF 
becomes, 


1 


—1 
fay, y) = ex |= 
" amoo, 1p} > (20-9 


| (15.46) 


where, 


i= [e Sm)? 2p(e=ms)y = my) | OY = My? 


15.4 
7 a z | (15.47) 


and p is the correlation coefficient defined by, 


_ E[@œ -mAy — my)] 
j= ae (15.48) 


2. More details on Gaussian PDF can be found in Appendix B. 
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For N jointly Gaussian random variables, the random vector x = {x}, x2, 
- ,xy}" has a jointly Gaussian PDF as shown below: 


_ 6 my)” Cy! «= m2) 


1 
feixa, E) = JONICA] sp ( 2 


where Cy, = E [& —m,)(x — m)’ ] and m, = E[x] are the auto-covariance 


(15.49) 


matrix and mean, respectively, of x, and |C, | denotes the determinant of Cxx. 
Further, 


T 
= 


Ca = E[xx’] — m,m? =T,, — mm? (15.50) 


where Iy is the autocorrelation matrix of x. 


15.8.1 Properties of Gaussian Random Processes 


e For Gaussian random processes, the knowledge of the mean and auto- 
correlation function gives a complete description of the process. This is because 
the joint PDF of a Gaussian process has only the mean vector and autocor- 
relation matrix as the two parameters. 

e Ifa Gaussian process {x(t)} is passed through a LTI system, the output pro- 
cess {y(t)} will also be a Gaussian process. This is because inear combinations 
of Gaussian random variables is also Gaussian. 

e For Gaussian random processes, wide-sense stationarity and strict-sense station- 
arity are equivalent. This follows from the fact that Gaussian PDF uses only 
up to second order statistics (mean and autocorrelation). 

e For Gaussian random processes, uncorrelatedness and independence are equiv- 
alent. 


This is because the exponent (x — my)? Cz! (x — m,) in the joint PDF 
becomes pe Cy, (i, 1) (4; — m x) when the process is uncorrelated. This 
results in the joint PDF becoming a product of the N marginal PDFs. 


15.9 Complex Stochastic Processes 


A complex stochastic process is defined by, 
z(t) = x(t) + jyt) (15.51) 


with x(t) and y(t) are real stochastic processes. Such a process is said to be station- 
ary if x(t) and y(t) are jointly stationary. Expectation and autocorrelation function 
of a complex stochastic process is defined as 


ERG] = Elx() + jy@®] = EXO] + JEDE] (15.52) 
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and 
Yzz(t,t +7) = E[z(t)z*(t + 7)] (15.53) 


where * indicates the complex conjugate. 
For the autocovariance function, the above Eq. (15.53) can be used, where z(t) 
is replaced with z(t) — E[z(t)]. This yields 


Cet t+t) = yet, t+) - EROE“ + 7)] (15.54) 
The cross-correlation function of two complex processes p(t) and q(t) reads 
Yog (t,t +7) = E[p@q*(t + 1)] (15.55) 
and the cross-covariance function is found from Eq. (15.56) below: 
Cpt, t +t) = Ypg(t,t +1) — ElpMIE* [q(t + 7). (15.56) 


One may wonder why the correlation functions of complex processes are defined 
in the way it has been done in Eqs. (15.53) and (15.55). The explanation for this 
arises from an engineering point of view; the given expressions of the correlation 
functions evaluated for t = 0 have to result in the expectation of the squared 
process for real processes. 


15.10 Ergodic Processes 


Estimation of ensemble averages of a random process requires a large number of 
realizations of the process. This is not feasible since we usually have only one real- 
ization of the process in any practical situation. Using one realization, all that we 
can obtain are time averages. Therefore, if the process is ergodic, we can replace the 
ensemble averages by time averages. 

A stationary random process is said to be ergodic if its ensemble averages are equal 
to time averages. It has to satisfy the following conditions: 


My = x(t) = E[x(t)] =m, (15.57) 
¥xx(T) = x(t)x(t + 1) = Efx(t)x(t + t)] = Yxx(T) (15.58) 


where, “y = x(t) and fys (t) = x(t)x(t + T) are the time averages of the mean 
and autocorrelation, respectively of the ergodic random process x (t). By assuming 
ergodicity, a number of important statistical properties (such as the mean and auto- 
correlation) ofa process may be estimated from the observation of a single available 
realization. 
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1510.1 Mean 


For an ergodic process x(t), the time averaged mean is given by 
3 1 
m, =x(t)= lim T x(t)dt, (15.59) 


where T is the observation period. 


15.10.2 Correlation 


Correlation and power spectrum are other two closely related statistics of random 
signals. We will introduce correlation for the ergodic process in this subsection and 
power spectrum in the next subsection. 


Cross-Correlation: The time averaged cross-correlation between two random sig- 


nals x(t) and y(t) is defined as 


Pry(t) = x* Oy + 7) 


1 T/2 
= lim =J x*(t)y(t + t)dt (15.60) 
-T/2 


T= œ 


where T is a time shift. That is, Jxy(T) is a measure of the similarity between x(t) 
and y(t + t). In several applications, we would like to know the value of t at 
which the cross-correlation Jxy(t) becomes maximum.’ In other words, yy(7) is 
a measure of how much information does x(t) have about y(t + 7). If x(t) and 
y(t) are independent signals, then there is no correlation or dependence between 
them. Hence, for independent or uncorrelated signals, we can write, 


Jay(t) = x*OyE+1) =x) y+ T) 
=x)’ yO) =m" -My (15.61) 


where My is the mean of y(t). We have the following remarks. 


© Ifyxy(c) = M% : My for all values of 7, then we say that the signals x(t) and 
y(t) are uncorrelated signals. 


3. For example, when we transmit a signal s(t), let the received signal be y(t) = s(t — to) + n(t) where to 
is a time-delay caused by the channel and n(t) is the channel noise. At the receiver, we may want to know 
the value of to. To determine this, we can compute the cross-correlation js (t) = s*(t)y(t + t). Then, we 
will find that |7sy(z)| will have a peak when t = tọ. 


350 Random Signals 


Figure 15.11. Illustration of the steps involved in estimating the CCF between two finite 
duration functions. 


e Ifx(t) and y(t) are uncorrelated signals with either m, = 0 or my = 0, then 
we have 


Pxy(t) =0 forall t (15.62) 
Power [ax (t) + By()] = lal’ px + |El? py (15.63) 


where a and £ are two scalars, and py and py are the powers of x(t) and 
y(t), respectively. With a = 1 = 2, Eq. (15.63) becomes, 


Power [x(t) + y(t)] = px + Py. (15.64) 


That is, power of a sum of uncorrelated zero-mean signals is equal to the sum of 
the individual powers. 


Figure 15.11 illustrates the process of estimation of cross-correlation function 
(CCF) between two functions x(t) and y(t). 
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Autocorrelation: When y(t) = x(t), we get from Eq. (15.60) 


T/2 
Pxx(T) = x* (t)x(t +7) = jim. z J „7 O0 +t)dt (15.65) 


and this is called the autocorrelation of x(t). Thus, Yxx(t) is a measure of the 
similarity of x(t) with its shifted version. That is, it is a measure of the redun- 
dancy (or, self-similarity) within x(t). Based on this interpretation, we can state 
the following. 


e Autocorrelation Pyy (Tt) becomes maximum when t = 0, since the maximum 


self-similarity occurs when we do not shift the signal. Further, note from 


Eq. (15.65) that 
Frx(O) = x*(t)x(t) = |x A)|? = px = Power. (15.66) 


Thus, power of the signal is equal to autocorrelation with no time shift (i.e., 


t = 0). Thus, we have 
l?xx(7)| < ¥xx (0) for all Ce (15.67) 


e In general, autocorrelation or self-similarity decreases as t becomes large. 
So, from Eq. (15.61), we get 


Vex (tT) = l = |Mean|? for large T. (15.68) 
The steps involved in the estimation of the ACF of a signal, x(t) is illustrated in 
Fig. 15.12. 
15.10.53 Variance and Power 


Power and variance are closely related to each other and hence we shall consider 
them together in this subsection. The power of a random signal x(t) is the average 


of the magnitude-square of the signal, i.e., it is the mean-square value |x (t)|? of the 
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ACF 


Figure 15.12. Illustration of the steps involved in estimating the ACF of a finite duration 
function. 


signal. Denoting the power by px, we get 


ee 1 T/2 
Power, py = |x(t)|? = lim al |x(t)|7dt. (15.69) 
T=>œ T -7/2 


The variance (denoted by G2) of a random signal is the power of the signal afier 


removing the mean, i.e., it is the power of x(t) — mx. So, we get 


———— 1 T/2 
Variance, 52 = |x(t)— ml = jim. ie. |x(t) — my? dt. (15.70) 


Variance is a measure of the spread in the signal amplitude with respect to its mean. 
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Relation between Power and Variance: Note that 


Ix(t) — Mrl? = |x? — my -x*() — me - x(t) + xl? (15.71) 


where x* (t) and m* are complex conjugates of x (t) and m,, respectively. Since mx 
is independent of t, and the mean of x*(t) is m%, we get 


My -x*(1) =m, XO) =m, xO = (mM, (15.72) 


me x(t) = ll, gl” = [nel (15.73) 
Using Eqn. (15.71) in Eq. (15.70), we can express the variance as 


Variance, 02 = |x(t) — ñ|? = |x(0)|2 — l (15.74) 


x 


= Variance = Power — |Mean|? . (15.75) 


Eq. (15.10.3) shows that power and variance of a signal are equal if its mean is zero. 
Thus, for signals with zero mean, we have 


Variance = Power = Mean-square value = |x(t)|?. (15.76) 


It is easy to verify that the power and variance of the sinusoidal random signal in 
Eg. (15.1) are equal and is given by a 

Because of the squaring operation in Eqs. (15.69) and (15.70), the power and 
variance are not linear operators. That is, 


Power [axı (t) + Bx2(t)] 4 a Power [x1 (t)] + Power [x2 (t)]. (15.77) 


Similar equation holds for variance also. 
§ Examine if ergodocity implies stationarity, or vice versa? 


Two stochastic processes x(t) and y(t) are jointly ergodic if the individual pro- 
cesses are ergodic and if the time-averaged cross-correlation function equals the 
statistical cross-correlation. That is, 


Pry(t) =xQ)y@ + 1) = Elxy + 7)] = yxy(7) (15.78) 
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Figure 15.13. Signal x(t) and its truncated version x7 (t). 


If we have only one realization of a random process x(t), we can assume it 
to be ergodic (unless otherwise specified) for further analysis where its time aver- 
ages becomes ensemble averages. This means that j;x(t) = yxx(T), Mx = mx, 
etc. Hence, in the rest of the book, the time averages are replaced with ensemble 
averages. 


15.11 Power Spectrum 


The statistics that we have considered so far (i.e., mean, power, variance, and cor- 
relation) are related to the time-domain description of the random signal. While 
mean, power and variance are constants, correlation is a function of the time- 
shift t. On the other hand, power spectrum (or power spectral density (PSD)) 
is a frequency-domain statistic. The power spectrum of the random signal x (f) is 


defined as, 


1 
Pux(f) = im = IXr(f)I? (15.79) 


oo : T/2 : 
xp (tye iF dt =) xe dt. 
-T/2 


where Xr(f) = 


—Co 


(15.80) 


Here, x7(t) is nothing but x(t) truncated to the interval [-4, T] as shown in 
Fig. 15.13. 

The power spectrum Txx( f) gives the distribution of the power in x(t) with fre- 
quency. For example, the power of x(t) in the frequency band [ f1, f2] is given by 
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the integral a Txx(f)df. So, the total power in x(t) can be expressed as 
oO E 
tome prs J Laal Pdf = Yax 0) = KOR. (15.81) 
— 


Equation (15.81) shows the various ways (time-domain and frequency-domain) 
of expressing the total power in x(f). 


Wiener-Khinchin Theorem: This theorem relates the autocorrelation and power 


spectrum. For stationary random processes, the power spectral density (PSD) 
I'yx(f) and autocorrelation function are Fourier transforms of each other. That 


is, we have 
oo . 
Txx(f) =| Yxx(t)e i dr (15.82) 
-o0 | 
of Ya) = / Vix (fel?*s* df. (15.83) 
— 00 


Thus, to determine the power spectrum, it is enough that we determine the autocor- 
relation and then find its Fourier transform. This approach can be used to estimate 
power spectrum of measured random signals. 

Some features of the PSD are listed below. 


e The PSD Txx(f) is always real and non-negative. 

e The PSD of a real-valued random process is even symmetric. That is, 
Txx(f) = Txx(— f). This may not be true for complex-valued processes. 

© Im{Ixx(f)} = 0. Here, Im{.} is defined as the imaginary part of the quan- 
tity within the braces. 

e The quantity z- Txx(f)df is the average contribution of the frequency com- 
ponents in the range [ f, f + df] to the total power. We also note that 


1 T 
yx(0) = E [OP] = f aar 058 


The Cross-Power Spectrum: The cross-power spectrum can be defined as the 


Fourier transform of the cross-correlation function. 


Vxy(f) =i Yxy(t)e dr (15.85) 


or pxy(t) = / i Lyry (f)e 7 df. (15.86) 
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15.12 Linear Filtering of Random Signals 


In practical applications, we often need to filter random signals. For example, in 
communication systems, we need to filter the signal at the transmitter to ensure that 
the transmitted signal does not exceed the allocated bandwidth. At the receiver, we 
need to filter the received signal to reject noise and interferences that are outside 
the signal bandwidth of interest, as well as to shape the signal according to some 
requirements. Similarly, the measured signals in all practical applications are first 
passed through some filters to appropriately condition the signal. 


§ In the design and analysis of systems (e.g., transmitter, receiver, front-end filters, etc.), it is 
required to know how the various statistics (e.g., mean, power, variance, correlation, power 


spectrum) change due to these filtering operations. 


Let y(t) be the output of the filter with impulse response h(t), when the input is 
x(t). Further, let yr (t) be the output when the input is xy (t), where x7 (t) is as 
defined in Section 15.11. Then, we get 


CO 


y(t) = x(t) @ h(t) = I hE E = dr (15.87) 


yr(t)=xr@)@hO), Yr(f)=A(f)Xr(/f). (15.88) 


Using the definitions of mean, power and correlation, we shall now examine the 
various statistics of the output signal y(t). 


Mean: We get the mean of y(t) as 


my = y(t) = a h(t)x(t — t)dt’ = D h(t')x(t — t’)dt’ 


[0.0] 
= mM; | h(t')dt’ (15.89) 
J —OO 
since mean my = x(t) = x(t — t’) is independent of time. 


4. | What is important in Section 15.12 is the meaning of the results. The derivation of the formulas may be 
omitted. 
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Power Spectrum: We get the power spectrum of y(t) as 


_ ` 1 2 _ 7: 1 2 
Py (A) = lim IYr = lim = NXP! 
. 1 
= |H (f)? lim = [Xr =E Tf) 15.90) 
T=>œ T 
since H (f) is independent of T and Fyx(f) is the power spectrum of the input 
signal x(t). 


Autocorrelation: Using Eq. (15.83), we can get the autocorrelation of y(t) by 
taking the inverse Fourier transform of power spectrum I’,,(f). Since multipli- 
cation in frequency domain is equivalent to convolution in time domain, we get 


ny) =F" [Py (N] = F7 [APPA 
= F! ha] BD F! Teel = rah) Q Yxx(t) (15.91) 


where rpn (T) is the inverse Fourier transform of |H(f)|?. Please note that h(t), 
the impulse response of the filter is a deterministic process and its ACF is denoted 
as ran (T). 


Power: We get the power of y(t) as 


p= / Tair = L HPE (Pdf. (15.92) 


Cross-Correlation: Using Eq. (15.87), we get the cross-correlation yxy (t) between 


input x(t) and output y(t) as 


Yay (t) =X (yO F T) = x* (t) / Etr 


= [ x*(j\x(t +71 —t/)h(t')dt’ 


= J. yax(t — t)h (tdt = yxx(t) Q h(t). (15.93) 


5. Note that |H(f)I? = H(f)H*(f), and the Fourier transform of h*(—t) is H*(f). Therefore, we get 
rin (t) =F" [IE] = FLAP) @ F~ [A*(f)] = hA 8 h* (t). 
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Thus, Eqs. (15.89) to (15.93) show that the output statistics can be obtained from 
the input statistics and knowledge of the filter. 


15.13 White Noise 


White noise (denoted as n(t)) isa random signal whose power spectrum is flat over 
all the frequencies.° That is, we have 


Fan f) =K forall f, (15.94) 


where, K is just a scalar variable which specifies the value of the power spectrum at 
each frequency. Thus, all the frequencies have equal weight in the power spectrum of 
white noise. Taking inverse Fourier transform of Inn (f), we get the autocorrelation 
of white noise as 


Ynn(t) = Ko(r) (15.95) 
=> Ynn(t) =0 for all t Æ 0. (15.96) 
Thus, the autocorrelation of white noise is zero for all t except t = O, i.e., 


white noise is uncorrelated even for an arbitrarily small time shift. For this reason, 
white noise is said to be a completely uncorrelated signal (or, highly random signal). 
In view of Eq. (15.68), Eq. (15.96) implies that the mean of white noise must 
be zero. 

Eq. (15.94) implies that the power of white noise is infinity. Clearly, such a sig- 
nal cannot exist in practice. Nevertheless, white noise is used extensively in the 
development and analysis of several practical systems (e.g., communication sys- 
tems which assume the channel noise to be white) since the bandwidth of the noise 
is much much larger than the bandwidth of the underlying desired signal. So, as far as 
the signal is concerned, the noise appears like a white noise, even though it is not truly 
white. 


White Noise Processes: The random process {n[n]} is said to be a white noise 


process if its PSD is flat over all the frequencies, i.e., if Tune?” is a constant for 
f €[—a, a]. Therefore, its autocorrelation is given by, 


T 


1 ok 
Ynn[k] = = (constant)e™ i *do (15.97) 
T 


mT 


6. The thermal noise caused by a resistor has a power spectrum that is flat over a really wide bandwidth. 
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This means that, 


if k4#0 


if k=0. (1599) 


0 
Ynnlk] E p, 


n 


Therefore, we may also say that {n[n]} is a white noise process if its mean is zero, 
and n[n] and n[m] are uncorrelated for n # m. It is called strictly white if its mean 
is zero, and n[n] and n[m] are independent for n # m. 


§ It is often assumed that the noise observed in most of the communications channels is white 
and Gaussian. Is this justifiable? 
§ In discrete-time processing, we use discrete-time white noise in place of continuous-time 


white noise. Examine the relation between these two noises. 


15.14 Properties of ACF 


Some of the important properties of ACFs for different types (random, periodic 
and aperiodic) of signals (x(t)) is provided in Table 15.1 below. 


Table 15.1. Important properties of ACF. 


Random Signals Periodic Signals Aperiodic Signals 
Yxx(T) = Yxx(—T) rxx(T) =1rxx(-T) Ixx(T) = rxx(-T) 
Iyxx(T)| < Yxx (0) Irxx(T)| < rxx (0) Irxx(T)| < rxx(0) 
lim; Yxx(T) xx (T) =Pxx(t + Tp) lim; 500 xx (T) = coe 


= me = Px(DC) 
Px = Yxx(0) = m? Eg o? Px =1xx(0) Px = rxx (0) 
Yyy(T) = rah) ® yxx(t) ryy(t) =Trnh(t) 8 rxx(t) ryy(t) = rhh (T) @rxx(t) 


In the Table 15.1, Tp is the period of the periodic signal. px(pc) is the power of 
the d.c component of the signal. Similar properties exists for discrete-time signals 
as well. 


15.15 Properties of CCF 


Some of the important properties of CCFs for different types (random, periodic, 
and aperiodic) of signals (x(t) and y(t)) is provided in Table 15.2 below. 
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Table 15.2. Important properties of CCFs. 


Random Signals Periodic Signals Aperiodic Signals 


Yxy (7) = Yay(—T) rxy(T) = rxy(—T) rxy(t) = rxy(—t) 
Yxy(T) < y Yxx (0)yyy (0) rxy(t) <y rxx(O)ryy(O) rxy(t) < Vl xx (0)ryy (0) 


2|yxy(T)I < xx (0) + yy (0) 2|rxy(T)| < rxx(0) + ryy (0) 2|rxy(T)| < rxx(0) + ryy(0) 


lim; oo yxy (T) = mymy rxy(T) = rxy(t + Tp) lim 00 Fxy(T) = X00 Yoo 
Yxy(T) = MxMy Txy(T) =0, Vr rxy(t) = Xoo Yoo 
uncorrelated if no common frequencies uncorrelated 


Yyx(T) = h(t) @ yxx(t) ryx(t) = h(t) @ rxx(t) ryx(t) = h(t) @ rxx(t) 


15.16 Properties of Power Spectra 


Some of the important properties of power spectra for different types (random, 
periodic, and aperiodic) of signals (x(t)) is provided in Table 15.3 below. 


Table 15.3. Important properties of Power Spectra. 


Random Signals Periodic Signals Aperiodic Signals 

Txx (f) = Tyx (-f) Sxx (k) = Sxx (—k) Sxx (f) = Sxx (—f) 

Px = fe Tyx Pdf Px = ys Sxx (k) Px = Jo Sxx (f)df 
p= phar Px(DC) = Sxx(0) 

Dxx(f) = limr, +00 7; S(b) = IXH > 0 SIXA > 0 


E [IXO] 20 

X(f) = fo? xe*at 

Const. real spec., m25(f) Real discrete spec at f = T Const. real spec., x2,0(f) 
yy (f) = IHT) Syy) = |H E/T S) Syy f) =E Sex PD 


15.17 Properties of Cross-Power Spectra 


Some of the important properties of cross-power spectra for different types 
(random, periodic, and aperiodic) of signals (x(t) and y(t)) is provided in 
Table 15.4 below. 
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15.18 Concluding Remarks 


We can make the following concluding remarks based on the material presented in 


this chapter. 


e The signals that we encounter in many of the real-world practical applications 


are random in nature. 


e Characterization of random signals are done by means of specifying averages 


(or statistics) such as mean, power, correlation, etc. 


e When a random signal is applied to the input of a linear filter, the statistics of 


the output random signal can be computed from the knowledge of the input 


statistics and the filter impulse/frequency response. 


e The power spectrum of white noise is flat over all the frequencies. Therefore, 


white noise is a completely uncorrelated signal. 


Exercises 


15.1. 


Starting with the continuous time-average definition of the autocorre- 
lation function (ACF), prove that the Fourier Transform of the ACF is 
the power spectral density (PSD) of the signal. 


15.2. A signal x(t) is transmitted through a channel. The received signal y(t) 


15.3. 


15.4. 


is scaled, shifted, and noisy version of x(t) given as y(t) = ax(t — 
to) + y(t), where a is a scale factor, tg is the time delay and y(t) is the 
noise. Assume that the noise process has zero mean and is statistically 
independent of the signal process, and that all process are stationary. 


(a) Derive expressions for the mean and the ACF of y(t) in terms of 
the statistics of x(t) and y(t). 


Derive an expression for the ACF of the signal x(t) = sin(wot). Use the 
time-average definition of the ACF. From the ACF, derive an expression 
for the PSD of the signal. Show all steps. 

A rhythmic episode of a theta (0) wave in an EEG (electroencephalo- 
gram - brain signals) signal is approximated by a researcher to be a sine 
wave of frequency 5Hz. The signal is sampled at 100 Hz. 


(a) Draw a schematic representation of the ACF of the episode for 
delays up to 0.5 seconds. Label the time axis in samples and in sec- 
onds. 

(b) Draw a schematic representation of the PSD of the episode. Label 
the frequency axis in Hz. 
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15.5. 


15.6. 


A digital random signal x1 [7] gets the values of 0 and 1 with equal prob- 
ability equal to 0.5. The signal xı [7] is assumed to be ergodic. The sam- 
ples of the signal x[n] and x;[m] are uncorrelated when n 4 m. 


(a) Find and sketch the one dimensional probability density function 
fx(x1) of the signal and calculate the mean and the power of the 
signal. 

(b) Show that the autocorrelation function (ACF) of x1 [7] is 


c fo k=0 
Yxıxı [k] = l 


otherwise, 
and find the constants c and d. Sketch one period of the power 
spectrum of the signal. 
(c) The digital random signal xo[n] is derived from x1 [7] so that xo[n] 
gets the value 1 when x;[n] = 0, and the value 0 when x[n] = 1. 
The cross-correlation )x,x)[k] between x;[n] and xo[7] is given 


by 


0 for k=0 
Vx1x9 Lk] = y 


otherwise. 


Sketch one period of the cross power spectrum Ty; x (f), and find 
the cross-correlation function yx x,[k] between xo[n] and x[n]. 
Finally, find the ACF and the power spectrum of the digital random 
signal y[n] = x[n] — xo[n]. 
Consider the analog random signal x(t) with a rectangular probability 
density function. The ACF of x(t) is given by, 


Yxx(t) = Ad(r), 


where A is a positive real constant. 
The signal x(t) is filtered by a filter whose impulse response is 
given by 


for O0O<t<T 
otherwise, 


h(t) = Ei 


where a and T are positive real constants. The result of the filtration is 
the random signal y(t). 
(a) Find the mean value E{x(t)} of x(t) and the transfer function 


H(f) of h(t) expressed in terms of a and T. Find an expression 
for the ACF of h(t) expressed in a and T. 
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(b) Find the ACF yyy(t) of y(t) and its power spectrum Tyy(f) 
expressed by a, A and T. 

(c) What is the probability density function that y(t) can be assumed 
to have, and find the mean and the standard deviation of y(t) 
expressed by a, A and T. 

(d) The analog signal y(t) is converted to a digital signal after the filtra- 
tion with an ideal low-pass filter, whose transfer function is given by: 


Hp (f) = l for |f| <4/T 


otherwise. 

The noise generated in the sampling process is assumed to have neg- 
ligible power, and unimportant in our further considerations. Sug- 
gest the minimum possible sampling frequency expressed in terms 
of T, so that the analog and the digital signals are equivalent. Sketch 
the power spectrum (I'yy(f)) of the sampled signal. Give the ampli- 
tude of the spectrum at f = 0 expressed by A, a and T. Note the 
zeros in the power spectrum for |f| < ? for the chosen sampling 
frequency. 


15.7. The autoregressive (AR) process generator consists of a digital genera- 


tor of white noise followed by a time-invariant recursive digital filter as 
shown in Fig. P15.7. 


White noise Recursive 


generator filter 


Figure P15.7. 


The output from the white noise generator is denoted by x[n] and 
has a power px and a mean value E{x[n]} = 0. The ACF and power 
spectrum of x[n] are denoted by y,x[k] and Txx( fae respectively. The 
output y[n] of the digital filter is found by: 


Q 
yin] = x[n] + So bayin — q], 
q=1 


where Q is a positive integer number, and bg are real constants. The 
impulse response of the filter is denoted by h[n], its transfer function by 
H(f) and the sampling interval by Ty. The ACF and power spectrum 
of y[n] are denoted by yyy[k] and Fyy( D, respectively. 
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(a) 


(b) 


(c) 


(d) 


Draw a block diagram of the filter implemented in direct form II, 
and write down H(f) expressed by bg and Ts. Show that the filter 
is causal, and that A[O] = 1. 

Write down T,x(f) expressed by px, and sketch yxx[k]. Find 
Yyy[k] and py expressed by py and h[n]. Determine E{y[n]}. 
Because the filter is time invariant, we can shift in time both the 
input and the output so that we get: 


Q 
yin + k] = x[n +k] + Š bayin +k-—ql, 
q=1 


where k is an arbitrary integer number. Show that 


Q 
yrylk] = yxx[k] + Š Bg yxylk — q1, 
q=1 
where yxy[k] is the CCF between x[n] and y[n]. Explain why 
Yxy[k] = 0 for k < 0, and find y,y[k] when Q = 1. 
Show that 


Q 
Yyylk] = yxyl-k] + DS ba yyylk — 4], 
q=1 
and hereby derive yyy[k] expressed by yxy[k] and h[n]. Write a 
system (set) of equations, from which bg can be found, when yyy[k] 
is known. 


. In this problem, we will consider an analog random ergodic signal 


x(t). x(t) has a normally distributed probability density function f(x) 
given by 


ka 32,42 
fax) = Jt. ka (eka) . 


The ACF yxx(t) of x(t) is: 


¥xx(T) = pre rset 


where k1, k2, and fy are real constants, and py is the power of the signal. 


(a) Find kı and then express k2 through px. Write down the power 


density spectrum Ixx(f) of the signal expressed through py and 
f(x) (Do not solve any Fourier integrals.) 
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(b) x(t) is applied at the input of a frequency independent amplifier 
(same amplification for all frequencies). The output of the amplifier 
is denoted as y(t) and is given by: 


y(t) =ax(t) + z(t), 


where @ is a positive real constant and z(t) is a new random signal, 
which reflects the (for example) the overloading (no need to worry 
about this term as far as this problem is concerned) of the amplifier. 
Find the ACF yyy(T) of y(t) and the CCF y,y(t) between x(t) 
and y(t). Give the conditions under which yxy(T) = @yxx(t), 
and then find the power py of y(t), when this condition is fulfilled. 


Starting with the continuous time-average definition of the autocorre- 
lation function (ACF), prove that the Fourier Transform of the ACF is 
the power spectral density (PSD) of the signal. 

The block schematic of a LTI digital system is shown in Figure P15.8. 
Here x[n] and y[n] are the input and output, respectively of the system 
and h[n] is the system impulse response. The system is described by the 
difference equation, y[n] = x[n] — ax[n — 1]. Here, a is a real scalar 


x[n] yin] 


Figure P15.8. 


variable. 


It is assumed that x[n] is real and zero mean wide-sense stationary 


(WSS) random process with variance ø and its autocorrelation function 
(ACF), yxx[k], for delay k is defined as, yxx[k] = E [x[n]x[n — k]], 
where E[.] denotes the expectation operation. 


(a) Show that the variance o? of the output is given by, 
a = o? [1 + a? = 2apxs[1]], 


where pxx[1] = ia is the normalized ACF. 
(b) Show that o? attains its minimum value of c? [1 — p2,[1]] for 
a = pxx[1] (Hint: minimize o? with respect to a). 


(c) What is the condition under which o? < o? ? 
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15.11. 


15.12. 


The block schematic of a LTI digital system is shown in Fig. P15.9. Here, 
x[n] and y[n] are the input and output, respectively of the system. h[n] 
is the impulse response of the system. 


x[n] yin] 


Figure P15.9. 


The system is described by the difference equation, 
y[n] = 0.8y[n — 1] + x[n] + x[n — 1]. 


x[n] is a wide-sense stationary (WSS) random process with zero mean 
(i.e, E[x[n]] = m, = 0) and its autocorrelation function (ACF), 
yxx[k], for delay k is given by, 


1 Ikl 


(a) Determine the system function, H (z), and hence derive its impulse 
response, h[n]. 

(b) Determine the power spectral density (PSD), Tyy( f), of the output 
y[n]. Here f is the normalized frequency variable. (Hint: You may 
use “the theory of linear filtering of random signals” to derive the 
output PSD.) 

(c) Derive an expression for the ACF, yyy[k] of the output y[n]. (Hint: 
Use “Wiener-Khinchin theorem” to find yyy[k] from Py, ( f). You 
may have to use partial fraction expansion of T yy( f) here.) 

(d) Determine the variance, o? , of the output y[n]. (Hint: Use prop- 
erties of the ACF, yyy[k], to determine the variance.) 


Figure P15.10 shows a system with one input (x(t)) and one output 
(y(t)). As can be seen from the figure, it has two complex constants 
A and B. v(t) in the figure is an intermediate variable. Assume that 
x(t) is a stationary complex random process with mean zero and an 
autocorrelation function (ACF) yy (7) defined as yx,(t) = E[x(t + 
t)x*(t)]. Here, * denotes the complex conjugation. 


(a) Derive the expressions for the ACF (yyy(T)) of y(t) and the cross- 
correlation function (CCF) y,»(t) between x(t) and v (t) in terms 

of yxx(t) and the complex constants A and B. 
In the following (Fig. P15.11), the system in Fig. P15.10 has been 
modified to a two inputs (x(t) and w(t)) two outputs (y(t) and 
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y(t) 


Figure P15.10. 


w(t)) system, where w(t) is another stationary complex random 
process with mean zero and ACF yww(t) = E[w(t + t)w*(t)]. 
The CCF between x(t) and w(t), yxw(t) = E[x(t + t)w*(t)] is 
also given. As can be seen in the figure, the summation and multi- 
plication operations has been swapped within the system. 


y(t) 


Figure P15.11. 


Using the known parameters, Yxx (T), Yww(T), Yxw(T), A, and 
B, 
(b) Derive an expression for the ACF (yyy(T)) of y(t). 
(c) Derive expressions for the CCFs Yyw(T) between y(t) and w(t) 
and ywy(t) between w(t) and y(t). 
(d) Derive expressions for the CCFs yxy (t) between x (t) and y(t) and 
Yyx(T) between y(t) and x(t). 
Consider the block diagram representation of a LTI system as shown in 
Figure P2. Here x[n] and y[n] are the input and output, respectively of 
the system. h[n] is the impulse response of the system. The difference 
equation relating the input and the output of the system is given by, 


y[n] = ay[n — 1] + x[n]. 


Here, a is a scalar variable. 
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15.14. 


x[n] yin] 


Figure P15.12. 


(a) Determine the system function H(z), which is the z-transform of 
h[n] and suggest the range of values of a for which the system is 
stable. 

(b) Determine the first three (3) samples (i.e., A[0], A[1], and A[2]) of 
h[n] in terms of the variable a and hence determine the first three 
(3) values (i.e., rnn[0], rnn[1] and rpn[2]) of the autocorrelation 
sequence rnn [k] of h[n] in terms of a (Hint: By definition, rpp[k] = 
>. h[njh[n + k]; fork = 0, +1, +2, ...). 


n=—OO 


In the following, the value of a is chosen to be 5 in the input- 
output relationship of the LTI system. The system is excited with 
an input x[n] = (ay u[n], where u[n] is a unit step function. 

(c) Derive the expressions for the autocorrelation sequence ry x[k] of 
the input sequence x[n] and the cross-correlation sequence rxy[k] 
between the input x[n] and the output y[n] of the system (Hint: 
We have ryx[k] and Ryx(z) are z-transform pairs and Ryx(z) = 
X (z)X (27!) and Ryy(z) = X(z)¥ (z7)). 

(d) Derive the expressions for the autocorrelation sequence ryy[k] of 
the output sequence y[n] (Hint: Ryy(z) = ¥(z)¥(z7)). 

Consider the block diagram representation of a linear time-invariant 

(LTT) system as shown in Fig. P15.13. Here x(t) and y(t) are the input 

and output, respectively of the system. A(t) in the picture is the impulse 
response of the system. The system function H (f) (Fourier transform 
of h(t)) is given by, 


Hf) = Gs (=) rect £) 


Here, t is the time variable, f is the frequency variable and fe is a given 


specific frequency in Hz. 


x(t y(t 
=E 


Figure P15.13. 
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(a) Derive an expression for the autocorrelation function (ACF), raa (T) 
of the system. Here t is the delay variable (Hint: Make use of the 
Wiener-Khinchin theorem that relates the power spectrum and the 
ACF). 

At the system input, a signal is applied with power spectral density 
T'yx(f) = No + K(f). Here, No and K are scalars and 0(f) is 
an impulse function. Find the ACF of the input signal, y,, (T) and 


(b 


wm 


its mean value mx. 


~ 
a 
Sar 


For the output signal y(t), find the power py by using the sta- 
tistical characteristics of the input and the system (Hint: Use the 
rnh(t) and yxx(t) derived in Questions (a) and (b), respectively 
as well as the theory discussed in the linear filtering of random sig- 
nals topic). 

This problem involves the use of cross-correlation to detect a signal in 
noise and estimate the time delay in the signal. A signal x[n] consists 
of a pulsed sinusoid corrupted by a stationary zero mean white noise 
sequence. That is, 


x[n] = y[n — no] + wf[n], O<n<N-1 


where w[n] is the noise (white) with variance 02, N is the length of the 
data. The pulsed sinusoidal signal is given by, 


Acos(mpn), O<n<M-1 
0, otherwise. 


y[n] = | 


Here, A is the amplitude of the sinusoid and M is the pulse duration. 
The length M is chosen in such a way that the pulsed sinusoid has integer 
number of periods of the cosine waveform in it. The frequency œo of 
the sinusoid is known but the delay no, which is a positive integer, is 
unknown, and is to be determined by cross-correlating x[n] with y[n]. 
Assume that N > M + no. 

Let 


N-1 


rxylm] = >) x[nly[n — m], 
n=0 


denote the cross-correlation sequence between x[n] and y[n]. In the 
absence of noise, this function exhibits a peak at delay m = no. Thus 
the time-delay no is determined with no error. The presence of noise 
however can lead to errors in determining the unknown delay. 
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(a) For m = no, determine the expected value, Æ (rxy[nol). (Note: 
In the calculations, you may make use of the trigonometric iden- 


tity cos? (@on) = 5 [1 + cos(2@on)] and that the double frequency 


term averages to zero. That is, M >> 22. ) 


In the following question, we assume that the variance of ry y[no] 
(i.e., var[7xy[10]]), due to the presence of noise is given by, 


var[rxy[no]] = z Ow 


(b) Determine the signal-to-noise ratio (S NR), defined as, 


2 
SNR = (Elrzy [nol]) 
var[Txy [no]] 


(c) Discuss what is the effect of the pulse duration M on the SNR? 


15.16. This problem considers a random process y[n] that is generated by filter- 
ing a zero mean white noise x[n], with a time-invariant filter as shown in 
Fig. P15.14. The sampling interval Ts of the digital signal is normalized 


to unity. The symbol z~! in the figure represents a unit sample delay. 


0.04 


Figure P15.14. 


(a) Write down the difference equation describing the filter shown in 
Fig. P15.14. Derive the transfer function H(z) (in the z-domain) 
and the impulse response h[n] of the filter. 

(b) Sketch the magnitude response of the filter for |f| < 1. Is H(z) a 
low-pass system (filter)? 

In the following, we will assume that the variance of x[n] is 
a2 =1., 

(c) Find the power spectrum I'yy(f) of the output signal y[n]. Then 
find the autocorrelation yyy[k] of y[n]. 
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15.17. In a biomedical research laboratory, a researcher assumes the recorded 


electrical activities of the brain (EEG, electroencephalogram) to be a 
stationary random process and is denoted as x (t). 


(a) Starting with the continuous time-average definition of the auto- 
correlation function (ACF), prove that the Fourier Transform of the 
ACF is the power spectral density (PSD) of the signal, x(t). Show 
all steps. 

(b 


we 


The signal x(t) is transmitted to another research laboratory 
through a channel. The received signal y(t) is modelled as a scaled, 
shifted, and noisy version of x(t) given as y(t) = ax(t—to)+n(t), 
where a is a scale factor, tọ is the time delay and y(t) is the noise. 
Assume that the noise process has zero mean and is statistically inde- 
pendent of x (t), and that all process are stationary. Using the ensem- 
ble average definitions, derive expressions for the mean and the ACF 
of y(t) in terms of the statistics of x(t) and y(t) . Show all steps. 

If the researcher approximates x(t) to bea sine wave of frequency 


(c 


wa 


œo radians/second. That is, x(t) = sin(wof), using the time-average 
definition of the ACF, derive an expression for the PSD of the signal. 
Show all steps. 


15.18. A digital filter is described by the following difference equation 


1 
yh = 5 vlad aie) 


where y[n] is the output and x[n] is the input to the system. The filter 
: ; i ; 1\7 ; : 

is excited with an input x[n] = (3) u[n], where u[n] is the unit step 
sequence. 

(a) Determine the autocorrelation sequences ryx[m], ryylm], raal], 


and the cross-correlation sequence ryy[m], where m is the delay. 


15.19. The N-point DFT of a random sequence x[n] is 


N-1 
X[k] = > ele, k=0,1,...,N—1. 
n=0 
Assume that E[x[n]] = 0 and E[x[n]x*[n + m]] = o2ô[m] 
[i.e., x[7] is a white noise process]. 
(a) Determine the variance of the sequence X[k]. 
(b) Determine the autocorrelation of the sequence X[k]. 
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Chapter 16 


Modulation 


As you may recall, in Chapters 2 to 5, we studied about signals and systems and 
their representation in time and frequency domains. In this chapter, we will use 
these concepts to study modulation which is a very important part of radar (commu- 
nication systems) and medical ultrasound scanners (biomedical systems). In such 
systems, the strength of the received signal is related to the object that has reflected 
the transmitted pulse. Most importantly, we want to illustrate how a strong founda- 
tion in signals and systems makes it very easy for us to understand the various theoretical 
and practical aspects of modulation. 

By studying this chapter, we should be able to receive clarity and understanding 
on the following. 


e The reason for using modulation in communication/ultrasound systems. 

e Different type of modulation schemes, and the advantages and disadvantages 
of these schemes. 

e Important trade-offs underlying the design of communication/ultrasound 
systems. 

e Principles of analog and digital modulation, envelope demodulation, coher- 
ent demodulation, matched filtering, etc. 
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16.1 Introduction 


Let x(t) be a real-valued message signal (e.g., speech signal) that we want to trans- 
mit. Then, modulation is the process of impressing or loading x(t) onto another sig- 
nal c(t) called as the carrier signal’ which will carry x(t) from the transmitter to the 
receiver. The carrier signal is usually of the form 


c(t) = Ac cos(2a fet + 0e) (16.1) 


where Ac, fe, and @ denote the amplitude, frequency and phase of the carrier. We 
can impress x(t) onto c(t) by making x(t) modify any of these three parameters. 
As a result, we have three main categories of modulation schemes: 


© Amplitude Modulation (AM), 
© Frequency Modulation (FM), and 
e Phase Modulation (PM). 


The message signal is also known as modulating signal. The signal obtained by 
impressing the message onto the carrier is known as modulated carrier. The pro- 
cess of recovering the message signal from the modulated carrier is known as 
demodulation. 


16.1.1 Base-Band and Pass-Band Signals 
Let the one-sided bandwidth of x(t) be B Hz. That is,' 
[X(f)| =0 for |f| > B (16.2) 


where X(f) is the Fourier transform (FT) of x(t). Signals such as x(t) whose 
spectra lie in the vicinity of f = 0 (e.g., speech, biomedical signals etc.) are called 
base-band (or low-pass) signals. On the other hand, suppose we create a signal y(t) 
by multiplying x(t) with c(t). The spectrum of y(t) will then consist of bands 
of width 2B around fe and — fe (see Figure 16.4(a)—(b)).* Such signals whose 
spectra lie in bands away from f = 0 (e.g., signals transmitted by hand-phones) 
are called pass-band (or band-pass) signals. The process of modulation effectively 
converts base-band signals into pass-band signals. 


1. The carrier frequency fe is assumed to be much larger than the message bandwidth B, i.e., fe >> B. 
2. If y(t) = x(t)c(t) with c(t) given by (16.1), we get 
Ac ; . Ac _; 
YN = FIX- SAH xls + fe) (16.3) 
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16.1.2. Why Modulation? 


Or why use a high frequency carrier? 
Modulation of a carrier c(t) by a message signal x(t) is done to achieve one or 
more of the following objectives. 


e Matching between Signal and Channel: To shift the frequency band of the 
message signal to the pass-band of the channel so that spectrum of the trans- 


mitted signal matches the characteristics of the channel. 

e Antenna Size and Efficiency: For efficient transmission of signals, the 
antenna size should be comparable to the signal wavelength. Shifting the 
low-pass signals to higher frequencies using modulation allows antennas of 
practical sizes. 


— For example, consider the transmission of electromagnetic (EM) waves 
through space using antennas. The wavelength of an EM wave is given by 
A = $ = 210 Tr can be shown that the length of the antenna required 
to efficiently transmit the EM wave is © À. 

— For voice signal at a frequency f = 3 kHz, À is 100000m. 

— If f = 300 MHz, length of the antenna is 1m. 

— Higher the frequency of the carrier, the smaller the length of the antenna 
required. For example, a cellular (mobile) phone. 

— High frequency EM waves can propagate through atmosphere without 
much attenuation. For example, the space satellites use carrier frequency 
typically of the order of GHz. 


e Transmission of Multiple Messages: To make provision for the transmission 


of multiple message signals, for example, by shifting the signals to adjacent 
frequency bands around the carrier frequency (i.e., frequency division multi- 
plexing). 

e Noise Immunity: To expand the signal bandwidth so as to increase immunity 
(resistance) to noise during transmission. 

e Frequency Assignment: Using modulation, we can assign different frequency 


bands to different transmitting stations and/or programmes so that several 
stations and programmes can be simultaneously supported. 


16.1.3 Choice of Modulation Scheme 


The choice of modulation scheme depends on several factors such as, 


e Characteristics (e.g., bandwidth) and number of message signals to be 
transmitted. 
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e Channel characteristics (e.g., type of transmission medium, channel 
disturbances). 

e Performance requirements (e.g., received signal strength). 

e Complexity and cost (e.g., complexity and cost of hardware, power, and 
bandwidth requirements). 


The two most important resources in communication systems are channel 
bandwidth and transmission power. The trade-off between cost and performance in 
communication systems is mainly determined by these two resources.’ The vari- 
ous modulation schemes require different combinations of bandwidth and power, 
and hence these schemes offer different trade-offs between cost and performance. 
Depending upon the kind of trade-off that is affordable in a particular application, 
we choose the type of modulation scheme. 

We will now briefly discuss the principles, motivation, and main features of some 
of the modulation schemes. 


16.2 Amplitude Modulation (AM) 


In AM, we change the amplitude of the carrier c(t) using the message signal x(t). 
This is the most simplest to all modulation schemes to understand as well as to 
implement. We will explore a few types of AM schemes: 


e conventional AM, 

e AM with suppressed carrier (AM-SC), 
e single side-band AM (SSB-AM), and 
e quadrature AM (QAM). 


These schemes provide different compromises among bandwidth, power, complex- 
ity and performance. Without loss of generality, we assume, that Ac = 2 and 
Oe = 0 in this section. That is, the carrier is given by 


c(t) = 2 cos(27 fet). (16.4) 


16.2.1 Conventional AM (Conv-AM) 


The Conv-AM modulated signal is given by 


y(t) =2[a+x(t)] cos(2z fet) (16.5) 


3. Complexity of the transmitter and receiver is another major aspect that influences the cost performance 


trade-off. 
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Figure 16.1. A simple envelope detector (demodulator) circuit. 


where a is chosen such that 
a+x(t)>0 forall t. (16.6) 


The purpose of the condition on @ is to facilitate a simple mechanism, known as 
envelope detection, for demodulation. 


§ Let x(t) be a periodic square wave signal, whose one period is given by 


di k for 0< t <0.5Tp o 


—1 for 0.5To < t < To 


where To © 1/fe. Draw the Conv-AM signal y(t) for (a) a = 0 and (b) a = 1.5. 
Comment on the amplitude envelopes of the modulated signal in the two cases. 


16.2.1.1 Demodulation by Envelope Detection 


Equation (16.6) ensures that we can recover a + x(t) from y(t) by tracking the 
variations in the positive envelope (i.e., positive peak amplitude)‘ of y(t). Since a 
is known, we can recover x(t) from a + x(t). This is known as envelope detection. 
Thus, the receiver for Conv-AM is quite simple consisting of a half-wave rectifier 
followed by a low-pass filter (shown in Fig. 16.1).’ 

Figure 16.1 illustrates a simple envelope detection scheme. In this figure, D 
represents the rectifier, C is the capacitor and R is the resistor across which the 
output is taken. Input in this figure is an example of a modulated signal and the 
output is the extracted message signal. A (typical) modulating signal (Fig. 16.2(a)) 
and its envelope (Fig. 16.2(d)) is shown in Fig. 16.2. The original message signal 


4. IfEq. (16.6) is not satisfied, then the positive envelope of y(t) will be proportional to |a + x(t)| instead of 
a + x(t). Clearly, it is not possible to recover x(t) from |a + x(t)|. 


5. For envelope detection to be accurate, the time constant t of LPF must obey + & t «K 1 (i.e., small ‘charg- 
ing time constant’ and large ‘discharging time constant). This helps the LPF to reject the high-frequency 
carrier and noise, while capturing the low-frequency message signal. The time constant gives an indication 
of the speed with which the circuit can respond to changes. 
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Figure 16.2. Signals associated with an envelope detector: (a) Modulating signal, x(t), 
(b) Modulated signal, y(t), (c) Signal at the output of the rectifier in the circuit, and (d) 
Detected signal (marked in red) at the output of the envelope detector plotted along 
with the modulated signal. 


can be retrieved from the output (marked in red) signal by performing some signal 
processing techniques. 

If the signal x(t) is such that —Xmax < x(t) < Xmax» then Eq. (16.6) implies 
that we should choose a such that a > Xmax. Defining the modulation index for 
Conv-AM as 


p= me, (16.8) 


we see that envelope detection is possible only if 0 < pı < 1. 


16.2.1.2 Spectra of Signals 
The spectrum of y(t) is given by® 


Y(f) = [ad(f) + XAI BDO — fe) + OF + fol 
= al0(f — fc) + Of + fe] + IX = fo) + XCF + fol 6.9) 


6. Note: Recall that F [2 cos(2afet)] = Òf — fe) + Of + fc), Fla] = ad(f), and Flx@y@] = 
X(f) Q Y(f). Here, F denotes Fourier transform and ® denotes convolution. 
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Figure 16.3. Spectra of signals in conventional AM: (a) message signal x(t), (0) unmodu- 
lated carrier c(t), and (c) modulated (transmitted) signal y(r). 


Figure 16.3 shows the spectra of x(t), c(t) and y(t). Observe that the bands 
occupied by y(t) are 


—fe-B<f<—-f. +B, fe-B<f <fetB. (16.10) 


Thus, we see that transmission using Conv-AM requires double the bandwidth of 
the original message signal. Further, in addition to transmitting the message signal, 
we are also sending the carrier with power 2a, thus requiring extra transmission 
power. 


16.2.1.3 Summary of Conv-AM 


e The receiver is very simple (i.e., envelope detector), requiring no sophisticated 
approaches for demodulation. 

e Requires extra power to transmit the carrier (i.e., ac(t) in Eq. (16.5)) to 
facilitate envelope detection. 

e Requires double the bandwidth of the message signal. 

e The extra power required to transmit the carrier increases with decrease in the 
modulation index (or, increase in a). But lower modulation index improves 
noise immunity. 
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Figure 16.4. Spectra of signals in AM with suppressed carrier (AM-SC): (a) message sig- 
nal x(t), (0) modulated (transmitted) signal y(t), and (c) LPF input z(t). The LPF output is 
same as that in (a). 


The different AM schemes we discuss below make the system more efficient in the 
use of bandwidth and power. 


16.2.2 AM with Suppressed Carrier (AM-SC) 


To save power, the AM-SC scheme chooses not to send the carrier component ac(t) 
along with the message in Eq. (16.5). The modulated signal and its spectrum in 
AM-SC are given by 


y(t) = 2x(t) cos(2z fet) (16.11) 
Y(f)=X(f) @ [6 — fc) + OF + fol 
=([X(f - fo) +X(f + fo)l. (16.12) 


Figure 16.4(b) shows this spectrum. As in Conv-AM, the AM-SC also needs 
double the bandwidth of the original message signal. However, as Eq. (16.12) 
shows, the AM-SC transmits only the message signal component and hence, unlike 
Cony-AM, it does not waste power to transmit the carrier component. 
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16.2.21 Coherent Demodulation 


Unlike in Conv-AM, we cannot now recover x(t) from the positive envelope 
of y(t). But observe from Fig. 16.4 that if we multiply y(t) with the carrier 
cos(2z fet), we will get a X(f) in the base-band. That is, 


z(t) = y(t) cos(2z fet) = 2x(t) cos? (27 fet) 
= x(t) [1 + cos(272 f,t)] 
X(f —2fc) + X(f +2fc) 


=> Z(f)=X(f)+ (16.13) 


Figure 16.4(c) shows the spectrum Z(f). Since the spectra X(f — 2 fe) and 
X(f + 2fe) are situated around +2 fe, we can eliminate these by filtering z(t) 
with a LPF with cut-off frequency just above B Hz. Then, the LPF output will be 
same as x(t). This is illustrated in Fig. 16.4(c). 

For the above demodulation approach to work satisfactorily, the phase and fre- 
quency of the carrier used for demodulation at the receiver must be exactly same as that 
used for modulation at the transmitter. This is known as coherent demodulation. Any 
mismatch in phase and/or frequency of the carriers at transmitter and receiver will 
result in distortion in the recovered signal.” Therefore, it is very important to have 
special circuits at the receiver for generating the synchronous carrier. This makes the 
receiver expensive in systems where coherent demodulation is necessary. 


§ Use cos(2x fet +0) for demodulating the received AM-SC signal, where fo= fe+Af 
and 0 #0, with Af being an offset in the receiver carrier frequency. Using time domain 
as well as frequency-domain analysis, examine the effect of Af and 0 on demodulation. 


16.2.2.2 Compromise Approaches 


To ease the problem of generating synchronous carrier, various approaches can be 


adopted. 


© Approach 1: Send a weak carrier along with the AM-SC signal. 
e Approach 2: Send the carrier, once in a while, as pilot tones. 


The receiver could use the information about carrier to generate synchronous car- 
rier. In this way, it is possible to strike an acceptable compromise between cost (i.e., 
extra transmission power) and receiver complexity. 


7. Phase mismatch results in amplitude distortion and frequency mismatch results in frequency shift in the 
recovered message signal. 
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Figure 16.5. Spectra of signals in single side-band AM (SSB-AM): (a) message signal x(t), 
(b) AM-SC modulated signal with both side-bands, (c) upper side-band signal y„(t), and 
(d) lower side-band signal y(t). 


16.2.2.3 Summary of AM-SC 


e It transmits only the frequency-shifted message signal. Thus, compared to 
Cony-AM, the AM-SC scheme is power efficient. 

e Requires double the bandwidth of the message signal. 

e Receiver becomes complicated (and hence expensive) since it needs circuits 
for generating local carrier that is precisely synchronous with the carrier at 
the transmitter. It also must account for any changes in the carrier frequen- 
cy/phase that arise due to the channel. 

e The receiver complexity due to coherent demodulation can be minimized 
by resorting to the approaches of sending the carrier information using pilot 
tones or weak carrier. 
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16.2.3 Single Side-Band AM (SSB-AM) 


The SSB-AM scheme is an improvement over AM-SC to save bandwidth. Observe 
from Fig. 16.5(b) (this is same as Fig. 16.4(b)) that the transmitted signal in AM- 
SC consists of two copies of the original message spectrum X (f) shifted to + fe 
and — fe. We note the following from Fig. 16.5(b). 


e The spectrum shown in (blue) solid line (i.e., frequency bands [— fe — 
B, — fc] and [fc, fe + B] in Fig. 16.5(b)) contains complete information 
on the message X(f). This part is shown separately in Fig. 16.5(c) and is 
called the upper side-band. 

e The spectrum shown in (blue) dotted line (i.e., frequency bands [— fe, — fe + 
B]and [fe — B, fc] in Fig. 16.5(b)) also contains complete information on 
the message X (f). This part is shown separately in Fig. 16.5(d) and is called 
the lower side-band. 

e The upper and lower side-band signals contain exactly the same (and com- 
plete) information as the message signal x (t). 

e So, it is enough to transmit only one of the side-band signals. Thus, 
the bandwidth required for SSB-AM transmission is same as the message 


bandwidth. 
The upper side-band signal y,,(t) and lower side-band signal y;(t) can be gen- 
erated as 
yyu(t) = x(t) cos(2z fet) — X(t) sin(2z fet) (16.14) 
y(t) = x(t) cos(2z fet) + X(t) sin(2z fet) (16.15) 


where X(t) is —90° phase-shifted version of x (t) (obtained by passing x(t) through 
the so-called ‘Hilbert transformer filter). SSB-AM also uses coherent demodulation 
at the receiver. 


16.2.3.1 Summary of SSB-AM 


e Transmits only one side-band of the frequency-shifted message signal. Thus, 
SSB-AM is efficient in both power as well as bandwidth. 

e The receiver is complicated due to the requirement to have coherent demod- 
ulation, just as in the case of AM-SC. 

e SSB-AM systems require a 90° phase-shifter filter and/or band-pass filters 
with sharp cut-off characteristics (to filter the side-bands), which are costly 
to realize. 
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16.2.4 Quadrature AM (QAM) 


While the SSB-AM scheme saves bandwidth by cutting-off one of the redundant 
side-bands, its implementation can be costly because of the special filters needed. 
On the other hand, the QAM approach addresses the bandwidth efficiency issue 
by not cutting-off a side-band but by sending two message signals p(t) and q(t) 
(instead of only one message) in the same bandwidth. 

To ensure separability of the signals p(t) and q(t) at the receiver, they are 
modulated using two carriers? cos(2a fet) and sin(2z fet), respectively. The QAM 
modulated signal y(t) and its spectrum are given by’ 


y(t) = 2p(t) cos(2a fet) — 2q (t) sin(2z fet) (16.16) 
MASH" O Hf) ICU — fol) 
+P fe) = JO + fe) (16.17) 


where P(f) and Q(f) are the spectra of p(t) and q(t), respectively. 


16.2.41 QAM Demodulation 


Coherent demodulation is used for recovering p(t) and q(t) from the received 
y(t). Coherent demodulation using the carrier cos(2z fet) followed by low-pass 
filtering results in p(t). This can be seen as follows. 


P(t) = y(t) cos(2z fet) 
= 2 p(t) cos? (2r fet) — 2q (t) sin(2z fet) cos(2 fet) 
= p(t) + [p(t) cos(27 2 fet) — q(t) sin (27 2 f.t)] . (16.18) 


The spectra of p(t) cos(272 fet) and q(t) sin(27 2 fct) are located around +2 fe. 
Therefore, passing p(t) through a LPF with bandwidth B will recover p(t) and 
eliminate the components around +2 fe. Similarly, coherent demodulation using 
— sin(2z fet) followed by low-pass filtering results in q (t). 


16.2.4.2 Complex Representation of QAM 


The QAM modulation and demodulation operations can be expressed in equivalent 
complex representation as below. Noting that" cos(0) = Re {e/?} and — sin(@) = 


8. Since cos(2z fet + 90°) = —sin(2z fet), the carriers cos(27 fct) and sin(2a fet) are known as in-phase 
and quadrature carriers, respectively. 


9. Note: Recall that F [2 sin(2a fet)] = [O(f — fe) — Cf + fe) /i = jef — fe) + Of + fe). 


10. Here, Re{x} denotes the ‘real-part’ of the complex quantity x. 
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Re { je/}, we get 
2 p(t) cos(2a fet) = Re lapiga |, 
—2q(t) sin(2z fet) = Re {2 q (tyes? tet k 
=> y(t) = Re [2p et + 2jq(ePal | 
= Re [200er], (16.19) 


where v(t) = p(t) + jq(t). Equation (16.19) implies that p(t) and q(t) can 
be QAM modulated by modulating the complex signal p(t) + jq (t) using the 
complex carrier e/?*/¢! and taking real part of the resulting signal. 


16.2.4.3 How about the Demodulation 


Note that 
H(t) = y(Ne ift = 2Re fo@eat| on intel 
= E (teirt 4 oreja] ein fet 
=o(t)+ p* (teI CSN (16.20) 
=> LPF {5(t)}}=00) = pO + jq). (16.21) 


Thus, QAM demodulation is equivalent to coherently demodulating y(t) using 
the complex carrier e~/?” Se! and low-pass filtering the result. 


§ Examine the spectra of signals at various stages in QAM modulator and demodulator. 


16.2.4.4 Summary of QAM 


e Transmits two messages in the same bandwidth using in-phase and quadra- 
ture carriers. Thus, QAM is efficient in both power as well as bandwidth. 

e The receiver is complicated due to the requirement to have coherent demod- 
ulation, just as in AM-SC and SSB-AM. 

e In hardware complexity, QAM is simpler than SSB-AM. 


16.3 Frequency Modulation (FM) 


In FM, the message signal x (t) is impressed onto the carrier by changing the instan- 
taneous frequency of the carrier. FM has the advantage (compared to AM) of better 
resistance to noise, as noise affects amplitude much more seriously than frequency. 
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However, this advantage comes at the price of increased requirement on the channel 
bandwidth for transmitting FM signals. 

The instantaneous frequency fj (ft) and instantaneous phase 6; (t) of the modu- 
lated carrier in FM are given by 


fit) = fe + kext) (16.22) 
t 
> GO(t)= 2n | fi(t)dt (16.23) 
t 
= 2r fet + ark. f x(t)dt, (16.24) 


where ke is known as frequency sensitivity of the frequency modulator and it deter- 
mines the sensitivity of the instantaneous carrier frequency fj (t) to the message 
signal x(t). The resulting modulated signal is given by 


y(t) = Ac cos(6;(t)) 
t 
= A, cos (200 +2rk,. J rode), (16.25) 


where A¢ is a constant amplitude.'' Equations (16.22) and (16.25) show that 
demodulation ofa FM signal involves determining the instantaneous frequency fi; (t) 
of the FM signal and then subtracting the constant carrier frequency fe from fj(t). 


16.3.1 Bandwidth in FM Systems 


From Eq. (16.22), we get the maximum deviation of the instantaneous frequency 
from fe as 


A fmax = KeXmax where Xmax = max {|x (t)|}. (16.26) 


Then, the modulation index in FM is defined as 


p= Maximum Deviation in Carrier Frequency 
= Bandwidth of Message Signal 
_ A fmax kcXmax 


= 16.2 
r B ` (16.27) 


11. In phase modulation (PM), x(t) is used to directly modify the phase of the carrier as 6; (t) = 2a fet +kpx (t) 
where kp is the phase sensitivity parameter of the modulator. The resulting phase modulated signal is given 
by y(t) = Ae cos(0; (t)) = Ac cos (27 fet + kpx(t)). 
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where B is the bandwidth of x(t). Thus, we see that the frequency sensi- 
tivity parameter ke has significant influence on the bandwidth of FM sig- 
nals. The required transmission bandwidth increases with increase in ke, and 
vice versa. 


16.3.2 Narrow-Band and Wide-Band FM 


With AO(t) = 6; (t)— 27 fet, the FM signal given by Eq. (16.25) can be written as 
y(t) = Aec cos(9;(t)) = Ac cos (27 fet + AO(t)) (16.28) 

= Ac cos (2 fet) cos (AG (t)) 
— Ac sin (27 fet) sin (A0 (t)) (16.29) 


t t 
AO(t) = 2ak. | x(r)dz =p== f x(c)dz, (16.30) 


Xmax J—oo 


since ke = BB/Xmax. Depending on the maximum value of | A@(t)|, we classify 
the FM into narrow-band FM and wide-band FM. 


e Narrow-Band FM: This corresponds to the situation where | A@(t)| < 1 for 
all t. This happens when the modulation index 8 < 1. Under this condition, 


the FM signal in Eq. (16.29) can be approximated as’” 
y(t) © Ae cos (2a fet) — Ac A0 (t) sin (27 fet) (16.31) 


which is similar to Conv-AM signal with A@(t) as the message signal. Thus, 
bandwidth of narrow-band FM is similar to that of Conv-AM. 

e Wide-Band FM: When the value of £ is not very small (i.e., |A@(t)| is not 
small), then the spectrum of the resulting FM signal occupies a much wider 
band. This bandwidth expansion is the price that we pay for increased noise 
immunity in FM.” 


In the next section, the matched filter methods for the demodulation operation 
is discussed in detail. 


12. Note: cos(@) © 1 and sin(@) © 0 when |6| < 1. 


13. Clearly, narrow-band FM does not enjoy the noise immunity provided by wide-band FM. 
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Figure 16.6. Illustration of a FM Radar scheme. 
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Figure 16.7. Matched filter scheme. 


16.4 Detection (demodulation) by Matched Filter 


Many systems are based on the transmission and reception (detection) of pulses. 
Radar and medical ultrasound scanners are examples of such systems. In such sys- 
tems, the strength of the received signal is related to the object that has reflected 
the transmitted pulse. For example, a radar receives a stronger signal from bigger 
objects and weaker signals from smaller objects (Fig. 16.6). Such signals are often 
corrupted by noise, and it is therefore desirable to maximize the useful signals at the 
same time minimize the unwanted signals. A filter that is able to achieve the above 
objective is called the matched filter and in this section, the principle of matched 
filter scheme is discussed in detail. 
Let us assume that the received signal r (t) can be written as, 


r(t) = x(t) +n(t) (16.32) 


where x(t) is the desired response from the system - for example the echo from a 
single reflector, n (t) is the noise. We also assume that there is no correlation between 
x(t) and n(t). We want now a linear and time-invariant (LTT) filter (A(t) as shown 
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in Fig. 16.7) which maximizes the ratio between the power of the desired signal and 
that of the noise at a given time instant tm. This ratio is defined as, 


ly (tm)? 


where 
y(t) =x(t) 8 h(t) (16.34) 


is the filtered desired signal. y (tm) in Eq. (16.33) is the value of the signal at time 
instant fm. h(t) is the impulse response of the matched filter, y(t) is the output of 
the matched filter without the noise, and no(t) = h(t) @ n (t) is the filtered noise. 

If we assume the noise to be stationary, we can replace tm with t and the ratio in 
Eg. (16.33) can be expressed in the frequency domain as, 


Wede roo XH (fel?*fmaf? 
EnO) [2% Taa] 


Since n (t) is assumed stationary, its power is independent of time. Cyn (f) is the 


(16.35) 


power spectrum of the noise. If we assume that the noise is white, then we get, 


pa li. xe eas 
EnO o2 [7 HAAF 


(16.36) 


where o2 = Pnn (f) is the constant power density spectrum of the white noise. If 
we apply the Schwartz’ inequality, we get 


2 +00 +00 a 
< l IHA) Pdf / IX (fein Zap 


+00 
| / XH) "af 
(16.37) 


where the equality is achieved only for 
H(f) = ky (xey = ky X*(fye Jt Fim (16.38) 


where, kı is a constant. The maximum of the ratio is therefore reached when 
Eq. (16.38) is fulfilled. In this case, we have (assuming kı = 1) 


Did Je AP JAS Xe af 


EnO} T o2 [7 HAAF 
+00 2 
< be ae af = (16.39) 
oO oO 


n n 
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Here, E = i \X(f)|?df is the energy of the signal, x(t). We used the fact 
that f |p\?df = J p.p*df and the factor e/*ftm is of no significance. At the 
moment of detection, the magnitude of the filter output for the desired signal is 
proportional to its energy, E. 

The Fourier transform of the filter which maximizes the peak amplitude of the output 
signal relative to the noise is hence given by 


H(f) = ki X*(fye tim (16.40) 
which in the time domain is 
h(t) = kix (tm — t). (16.41) 


The LTT filter is a time-reversed and delayed version of the original noise-free 
signal. The time delay t is chosen so that the filter is causal. This means that the 
filter impulse response (A (t)) is matched to the desired signal (x (t)), and hence the 
name ‘Matched Filter’. 


16.5 Detection of Binary Signals in Noise 


Detecting signals in the presence of noise is a common task. In radars, one wants to 
decide whether there is an air-plane at time instant tm, and in telecommunications 
one wants to decide which symbol is being received. 

For example consider a simplified case of the binary signal x(t) as having the 
value either 0 or 1. When x(t) has passed through the matched filter h(t) we get 
the value K, when x(t) has the value 1. In other words, at time instant tm, we can 
have at the output of the matched filter either 


yiltm) = K + no(tm) (16.42) 


or 


yı (tm) = no(tm) (16.43) 


when x(t) has passed through a noisy channel and then filtered by the matched 
filter A(t) (see Fig. 16.8). We must have a threshold to decide whether the received 
signal is 0 or 1. Let the value of the threshold be u. This means that we assume 
X(tm) equal to 1 when yj(tm) > u and is O when y1 (tm) < u. 

There are two possibilities for error because of the noise. Either the noise 10 (tm) 
can decrease the value of y1 (tm), so that it becomes less than although x (tm) = 1, 
or yi(tm) > u although x(t) = 0. The first error means that a pulse is not 
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Figure 16.8. Matched filtering of binary signals: x(t) is the transmitted message (binary) 
signal, n(t) is the noise, which is getting added to x(t) to generate the received signal, 
r(t). r(t) * x(—t) is the filtering (convolution) operation between the received signal and 
the matched filter (with impulse response, f(t) = x(—r)). It also can be seen as the cross- 
correlation between the received signal and the transmitted signal. 


detected ( false negative) and the second error means that we detect a signal which 
is actually not there (fake positive). 

An example with Gaussian noise is shown in Fig. 16.9. The hatched area illus- 
trates how large the two possibilities are. It can be seen that there will be errors 
independent of the choice of u. The total probability of error depends on how 
often 0 and K are present in the signal. If K is infrequent, then the false negative 
error will be small. The total probability of error is 


Pf = PoP h + PKP fx; (16.44) 


where Po is the probability that x(tm) = 0, and Ph is the probability that 
No(tm) > u. Because there are only two symbols (0,1), we get 


Pf = PoPy + (1 — Po)P fe. (16.45) 
If we have the same probability for 0 and K, then we get 
1 
Preg (Pa + Pr) - (16.46) 


If the probability density function of the noise is symmetric about its mean value, 
then Pa = Pr, and the threshold u = K /2 since both types of the error have 
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Figure 16.9. Probability density functions for the signal yı (t). 


the same weight. The two probabilities Pf and P fp, for the case of Gaussian noise 
are given by, 


ak 


e (333 HE (16.47) 


Pf = Ph = Pr = a 
n 


and are dependent on u and oy, where oy is the Sendai deviation of the noise 
no(t). The probability for error is shown as a function of Æ in Fig. 16.10. 

However, the probability of the two symbols is often not oe and the choice of a 
threshold is not easy. 

The output of the matched filter at time instant tm is a signal whose amplitude is 
proportional to the energy of the transmitted pulse. If there is no echo, for example 
a radar pulse reflected by an air-plane, then only noise is present. This is a situation 
equivalent to that is given in Eq. (16.43). Therefore, we have the same probability 
of error, and the same method for determining the threshold value can be used. 
Hence s is the ratio between the energy of the received signal to twice the RMS 
value of the matched filtered noise. 
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Figure 16.10. Probability of bit error with Gaussian noise, when the probability of the two 
bits (symbols) are equal. 


Often in radar systems, Px is much smaller than Po and Px is usually unknown. 
Hence, the threshold value is usually determined empirically. 

So far, we have discussed the analog modulation schemes. The remaining of this 
chapter is devoted for the discussion on digital modulation schemes. 


16.6 Digital Modulation 


Many applications require the transmission of a digital signal via a modem, network 
or digital broadcasting. This section deals with the topic of transmission of digital 
data (bits) stream. Just as we have different approaches to modulate analog signals, 
we need approaches that can convert the stream of bits into waveforms that are 
suitable for transmission. There are three basic modulation types: 


e Amplitude (ASK - Amplitude Shift Keying), 
© Frequency (FSK - Frequency Shift Keying), and 
e Phase (PSK - Phase Shift Keying). 


Let the sequence {b1, b2, b3, b4, bs, ---} denote a stream of bits at the rate of 
$ bits/second, i.e., Tp is the duration of one bit. Each bit by, is either a ‘1’ or a 
‘0’. We first convert this bit sequence into analog signals and then modulate these 
signals using any of the approaches discussed above. 
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16.6.1 Amplitude Shift Keying (ASK) 


This is the simplest modulation scheme for digital data. It is a special case of AM. 
For the given data, an analog signal is generated as 


+1 for (KX-1I)I,<t<nTh if bn =1 


ra= G for (n—1)Tp <t <nT®p if b =0. Toan 


That is, we convert bit ‘1’ into a positive pulse and bit ‘0’ into a negative pulse, of 
width Tp each. Then, r(t) is obtained by concatenating the pulses corresponding 
to the bits in the sequence. The waveform r (t) is modulated using AM to result in 
the modulated signal 


p(t) =r(t)AsinQz fet), (16.49) 


where fe is the career frequency and A is its amplitude. Since r (t) sin(2z fet) is 
equivalent to switching the carrier amplitude to +1 or —1 during each bit interval 
depending on the value of the bit, this scheme is called “ASK”. It is also known as 
“On-Off Keying (OOK)” if the pulse amplitude r (t) is made zero when b, = 0, 
which is equivalent to switching ON and OFF the carrier if the bit is ‘I’ and ‘0’, 
respectively. 

The OOK signal corresponding to the binary string 10101011 is shown in 
Fig. 16.11. The top graph shows the ideal signal, and the bottom one shows the 
OOK signal. 

When the signal is received after transmission, the binary data stream must 
be recreated. This can be done by applying a matched filter, and then determin- 
ing whether 0 or 1 has been sent. If the probability for 0 and 1 are equal, the 
threshold value for detection is set to E/2, where E is the energy of the pulse 
p(t). (K in Eq. (16.42) corresponds to E, hence the probability of error is given 
in Fig. 16.10.) 


Example: The AM signal shown in the top graph in Fig. 16.11 is sent over a tele- 
phone channel with infinite bandwidth. The channel adds noise with Gaussian 
PDF and a constant power density of 1074 W/Hz with a bandwidth of fn = 5 kHz. 
Find the error probability. 

The energy of the signal after matched filtering is 


4/ fe a 
E = A’ sin“ (27 fet )dt 
0 


A2 f saj 2A2 


“afl? 4 h fe ae 
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Figure 16.11. ASK signal for the binary sequence 10101011 sent with fe = 250 Hz and 
T = 4/f- = 16 ms. (a) Original digital signal (bit stream) and (b) ASK signal with two 
amplitudes. 


As we know, the matched filter is a time-reversed version of the sent pulse. Its 
amplitude transfer function has a maximum value (amplification) exactly at the 
frequency of the transmitted pulse (f = fe). The transfer function is concentrated 
at f = fe and the amplification decreases for higher values of f. If we assume 
that the amplification is negligible for f > fe, we can find the power of the noise 


through Parseval’s equation: 


lee) Fy 
W= Í |H(f) [Vin Pdf = Tmn 0) I “ANd 


7 oo 5 B oo j B 2A2 
EmO fC df = mO f )dt = Pan) 
(16.51) 


where Inn(f) is the power density of the noise. The equation assumes that the 


noise is white and overestimates its noise. The ratio = is 
n 


2A2 
On = V Pa = ,| lnn (0) F 


C 


(16.52) 


242 


E 


F A? 
20n > |p. 02 (= Tnn (0) fo 


(16.53) 
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Figure 16.12. ASK signal for the binary sequence 10101011 sent with fe = 250 Hz and T = 
4/f- = 16 ms. (a) The top graph shows the ideal ASK signal, (b) The ASK signal with noise 
added, and (c) The signal after passing through a matched filter. The horizontal line in 
this graph depicts the threshold value of E/2, and the vertical line depict the detection 
moments. 


Substituting the given values in the above equation, we get 


a = 6.2dB (16.54) 
2c, V2x10-4x1200 ~~ : 


The probability for error is 2 x 107? (from Fig. 16.10). The various signals are 
shown in Fig. 16.12. for the binary sequence 10101011. Ifthe amplitude of the 
pulse is increased from 1 to 2 volts, we get a ratio of 12dB and the probability for 
detection error falls to 8 x 1075, which is a significant improvement. 

The probability of error is also dependent on whether the detection is performed 
at the right moment. It is therefore important that the receiver and transmitter are 
synchronized. 

If the noise is white, then a simple relation for calculating the error probability 
can be derived. It gives insight in to the influence of the noise and the filter. If 
the noise is white, the power density is constant and the power of the noise after 


filtering is 


Pn = Tnn (O)E (16.55) 
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where E is the energy of the pulse p(t). We get the following ratio: 


E _ _E _] E (16.56) 
20n 2AT (OE Y 40 nn(0) l 


In other words, the probability of error is determined by the ratio between the energy 
ofthe transmitted pulse and the power density of the noise introduced by the transmission 
channel. 


16.6.2 Frequency Shift Keying (FSK) 


Digital information can be transmitted using pulses with different centre frequen- 
cies. We sent pı (t) for the symbol ‘1’ and po(t) for the symbol ‘0’ as follows: 


neve | ee for (n 7 1)Tp <t <nTp if by =1 (16.57) 
otherwise 

n= Asin(2z fot) for (n - 1)Tp <t <nTp if b, =0 (16.58) 
(0) otherwise 


where fıTp and foTp are integers. 

The binary string 10101011 is sent as shown in Fig. 16.13. We shift between 
frequency values and the method therefore is called the FSK. The individual FSK 
signals po(t) and pı (t), corresponding to bits 0 and 1 are shown in Fig. 16.14. 

Two matched filters are used for the detection: one for each pulse type. At the 
moment of detection, the value of the signal from the filters is proportional to the 
value of the energy of the transmitted pulse. Energy of the two pulses are equal 
because they are equally long. Let this be E. One possible detection method is 
shown in Fig. 16.15. The received signal goes through the two matched filters whose 
outputs get subtracted. This processing step can be written as 


y(t) = x(t) @ hilt) — xf) @ halt) 
= x(t) Q (hı) — ho(0)). (16.59) 


Here, we neglected the presence of noise. At the moment of detection (tm), we get: 


y(tn) = T x(T)(hı(tm — T) — h2 (tm — t ))dī (16.60) 
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Figure 16.13. FSK signal for the binary sequence 10101011 sent with fı = 4 Hz, fo = 2 Hz 
and T = 16 ms. (a) The original (transmitted) signal (bit stream) and (b) The FSK signal 
with two frequencies for bits 1 and O. 
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Figure 16.14. FSK signal for the binary sequence 10101011 sent with fı = 4 Hz, fo = 2 Hz 
and T = 16 ms. (a) The FSK signal with two frequencies for bits 1 and O, (b) The FSK 
signal for bit O alone, and (c) The FSK signal for bit 1 alone. 
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Figure 16.15. Detector used for FSK modulation. 


x(t) 


Detector b(t) 


where hi (tm — t) = pi(tm — tm +t) = pi(t) (See Eq. (16.41)) and ho(tm — t) = 
Po(tm — tm + t) = po(t). At the moment of detection tm = 0, we get a signal 


Tp 
y(0) = f Asin(2z fıt)(A sin(2z fit) — A sin(2z fot))dt, (16.61) 
0 


when ‘1’ is received and the signal is noise-free. This can be re-written as 


Tp 
yO =E -f A sin(27 fı t)A sin(2z fot)dt 
f Tp 
=E-2 f EE I EE 


A2 Tp 
=E— =| (cos(2a2A ft) — cos(2x (fo + Af)t))dt. 
0 
(16.62) 


The value of the last integral will be 0, if we integrate over an integer number of 
periods of a sinusoidal signal with frequency Af = f ei 2. This is fulfilled when 
2T,pA f =k, where k is an integer number, and the two signals (A sin(27 fit) and 
A sin(2z fot)) are said to be orthogonal. 

A similar derivation can be carried out for the symbol ‘0’. We get, 


Tp 
y(0) = | A sin(27 fot) (A sin(2z fit) — A sin(2z fot))dt 
0 
=-E (16.63) 
The value that we get out of this detector is either E or —E depending on which 


pulse has been sent, when the two signals are orthogonal. The threshold value can 
be set to zero. 
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The noise present in the signal is also being filtered and the power of the remain- 
ing noise (at the output) is 


— / Hi (f) — Hafan Pdf, (16.64) 


where Cnn (f) is the power density of the noise and H1 (f) and H2(f) are the trans- 
fer functions of the two matched filters. If we assume that the noise has constant 
power in the pass-band of the two filters, we get 


m=EO [ Hi (f) — Hof) Pdf. (16.65) 


The last term in the above equation can be written as 
= f (H) — HTS) — Ay df 


CO 
= f (CAP + LDP = Ha DHEA) - HORG) df 
—0o 
(16.66) 
The last two terms are equal to the signal pı (t) convolved with a time-reversed 


version of the signal po(t), and the result is 0, since the two signals are orthogonal. 
We get hereby, 


ip STO) | (AZ + IPIS =2Fin(O)E. (16.67) 


This means that the power of the noise is doubled by the subtraction. 

The error probability can be found as in the case of ASK from Fig. 16.10. The 
threshold is set to 0. Hence, only noise samples with magnitude higher than E 
will cause an error. The power of the noise is doubled by the subtraction and the 
probability will be dependent on the ratio E /v/2øn. The ratio which determines 
the probability of error can be shown to be 


E 
|i- —_ / Fan (0) (16.68) 


In other words, we get 3dB improvement by using FSK rather than ASK. 


16.6.3 Phase Shift Keying (PSK) 


PSK is based on a shift in the phase of the signal, which is determined by the sym- 
bol (bit) being transmitted. When only two symbols are sent, the phase is shifted 
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Figure 16.16. PSK signal for the binary sequence 10101011 sent at fe = 250 Hz and T = 
2/fe = 16 ms. (a) Original digital signal (bit stream), and (b) The corresponding PSK 
signal. 


between z and 0. The signal corresponding to the binary sequence 10101011 is 
shown in Fig. 16.16. The individual PSK signals corresponding to bits 0 and 1 are 
shown in Fig. 16.17. 

A matched filter is used to recover the signal. The output of the filter is propor- 
tional to E when the received symbol is ‘1’ and —E when the received symbol is 
‘0’. The detection threshold is set to 0, if the two symbols are equally probable. The 
power of the noise at the output of the filter is pa = o2 = Paa (0)E. The ampli- 
tude of the noise must be larger than E to cause a false detection. The ratio which 


determines the probability of error is 


E E2 E 
a / Tin(OE j O ere 


which represents a 6dB improvement compared to ASK. This means that for 
the case given in the Example, we can transmit signals with an amplitude of 1 
volt and achieve error probability of 8 x 1075 by using PSK instead of ASK 
(2 x 107°). 
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Figure 16.17. Individual PSK signals for the bits 1 and O for the binary sequence 10101011. 
(a) Ideal PSK signal, (b) The PSK signal for bit O, and (c) The PSK signal for bit 1. 


16.7 2-Bit Quadrature Amplitude Modulation (QAM) 


The principles described here can be extended to n-bit QAM as well. Recall that 
the motivation for the development of QAM is to save bandwidth. In the same way, 
the 2-bit QAM is an approach to send more data bits (compared to ASK) through 
a channel of given bandwidth. This is explained below. 


e The sequence of bits {b1, b2, b3,b4,b5,---} is first converted into a 
sequence of symbols {s1, 52, 53, 84,---} where the symbols are defined by 
grouping 2 bits each as sı = {b1, b2}, s2 = {b3, b4}, s3 = {b5, bo}, s4 = 
{b7, bg}, and so on. Thus, the time-duration of each symbol is Ts = 2T}. 

e The sequence of symbols is then converted into two analog signals as 


_ {+l for (n — 1)T; < t <nT; ifs, =1 

"OVS be for (n — 1)T; < t < nT; if 5n,1 =0 Tet) 
_ {+l for (n —1)T; < t < nT; if sn2 = 1 

guys E for (n — 1)T; < t < nT; if sn2 = 0 O74) 


where Sy,1 and sn,2 are the first and second bits, respectively, in the symbol 
Sn = {8n,1, Sn,2}. That is, each symbol results in two pulses of widths T; each. 
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The resulting waveforms r (t) and q(t) are modulated using QAM and the 
modulated signal is given by 


y(t) = 2r (t) cos(2a fet) — 2q (t) sin(2z fet). (16.72) 


Since T; = 2Tp, we get 1/T; = 0.5/Tp. That is, the symbol-rate (i.e., 
number of symbols/second) is only half of the bit rate. For example, a bit rate 
of 10000 bits/second results in a symbol-rate of 5000 symbols/second. Therefore, 
the channel bandwidth we need to send the symbols using 2-bit QAM is only 
half of the bandwidth that we need to send the bits using ASK. Thus, the QAM 
approach can be used to achieve high data-rate transmission in bandwidth constrained 
channels. 


16.8 Concluding Remarks 


We can make the following concluding remarks based on the material presented in 


this chapter. 


Modulation is needed for matching the signal to the channel, and to support 
the transmission of several messages over a given channel. 

Modulation of a message onto a carrier is done by changing either the ampli- 
tude, frequency or phase of the carrier according to the message signal. 
While conventional AM is the most simple approach, it is inefficient in the 
use of power and bandwidth. 

AM-SC, SSB-AM, and QAM are efficient versions of AM. These approaches 
need coherent demodulation which makes the receiver complicated. 

FM has the advantage of noise immunity, which is obtained at the expense 
of increased bandwidth. 

The principle of matched filter for detection is described in detail. 

A demo Matlab programme, to show the application of Hilbert transform in 
communication is given in Appendix A. 


Exercises 


16.1. A message signal m(t) = 20cos(2mt), modulates a carrier c(t) = 


50 cos(100z t) to give a single-sideband wave. Determine the modulated 
waves when 

(a) only the upper sideband is transmitted, 

(b) only the lower sideband is transmitted. 
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16.2. An FM wave is described by s(t) = 100 cos[z2000000r + 0.005 cos 


16.3. 


16.4. 


16.5. 


(x 1000F)]. 


(a) Determine the instantaneous frequency of s(t). 
(b) What is the maximum frequency deviation? 

(c) What is the modulating message signal? 

(d) What is the modulation index? 


Sketch the digitally modulated waveforms for an input binary sequence 
1011010011, where the carrier frequency fe equals the bit rate, 1/ Tp, 
and T; is the bit interval, using 
(a) Amplitude Shift Keying (ASK) 
(b) 2-bit Quadrature Amplitude Modulation (QAM) 
Note: Assume that the pair of bits 00, 10, 11, and 01 are repre- 
sented by phase shifts equal to 0, 7/2, z, and 37/2. 


In creating a wireless home stereo system, an engineer is faced with the 
problem of sending two signals, xz (t) and xpr(t), for the left and right 
audio channels respectively, to another room. A senior engineer suggests 
using a modulated signal, y(t), whose amplitude is modulated by xz (t) 
using conventional AM and whose frequency is modulated by x p(t) using 
FM at a carrier frequency of fo Hz. 


(a) Write down the form for y(t). To evaluate the system, a test tone 
at 1 kHz is applied to both channels of the system. Write down an 
expression from which the spectrum of y(t) can be calculated. Is this 
expression mathematically tractable? 

(b) Suggest how xz (t) can be demodulated from y(t) of Question (a). Is 
coherent demodulation essential in the recovery of xz (t) and xp(t) 
from y(t)? Which of the two channel signals will have a higher qual- 
ity in the presence of noise and multi-path propagation? Explain your 
answer. If it is desired that both channels should have the same qual- 
ity in using the basic modulation scheme outlined, suggest how this 
can be done. 


An audio signal s (t) with the spectrum S(Q) (shown in Fig. P16.1) is to 
be transmitted in a communication scheme. In order to save the band- 
width, the signal spectrum is assumed to be 0 for |Q| > Qg = 2a x 4 
kHz. 


(a) Give the spectrum of the modulated signal sm (t) if the signal s(t) 
is modulated by cos(Qot) as shown in Fig. P16.2. Here Qo is the 
modulating frequency. 
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s(a) 
l 
=Ny 0 Qg 2 
Figure P16.1. 
s(t) = Sm (t) 
cos(Not) 
Figure P16.2. 


(b) How much bandwidth does Sm (Q) use compared to $(Q)? (Note: 


(c 


wa 


Represent it as a ratio of the bandwidth of Sm (Q) to the bandwidth 
of $(Q)) 

To overcome the disadvantage observed in Question (b), the sig- 
nal is transmitted according to the modulation scheme shown in 
Fig. P16.3. This is the single sideband (SSB) modulation scheme 
which takes advantage of the redundancy present in the spectrum 
of the real signal s (t). Draw the spectrum of Sg m (Q) and determine 
the bandwidth saving (if any) in the SSB scheme compared to the 
scheme in Question (a). 


s(t) cos(Qot) Sem(t) 


sin(Qot) 
Hilbert 
Transform 


Figure P16.3. 
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Chapter 17 


Power Spectrum Estimation 


In statistical signal processing and physics, the spectral density, power spectral den- 
sity (PSD), or energy spectral density (ESD), is a positive real function of a fre- 
quency variable associated with a stationary stochastic process, or a deterministic 
function of time. They have dimensions of power per Hz, or energy per Hz, respec- 
tively. It is often called simply the spectrum of the signal. Intuitively, the spectral 
density captures the frequency content of a stochastic process and helps identify the 
periodicity in the process. 

Power spectrum estimation methods can be divided generally into two classes: 
classical methods or non-parametric methods (based on the periodogram) and 
modern methods or parametric methods (based on models). In this chapter, we 
are going to discuss the following methods of power spectrum estimation: 


e Classical methods or Non-parametric methods 


— Periodogram approach, 
— Bartlett Method, Blackman & Tukey method, and 
— Welch Method. 


e Modern methods OR Parametric methods 


— AR (autoregressive), 
— MA (moving average), and 
— ARMA (autoregressive and moving average) 
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Also, topics such as, DFT for spectrum estimation, windowing for spectrum 
estimation, time and frequency resolutions and spectral smoothing, are also dealt 
with in detail. 

One of the major problems in spectrum estimation is the finite length of the 
available data, which will be discussed in the following section. 


17.1 Estimation of Spectra from Finite Data 


The availability of data only for a finite length is a major limitation on the qual- 
ity of the power spectrum estimate. When dealing with statistically stationary sig- 
nals, longer data record results in better estimate of the spectra. For non-stationary 
signals, the length of the data selected is determined by the rapidity of the time 
variations of signal statistics. 

One of the problems that we encounter with the classical power estimation meth- 
ods using a finite-length data is the distortion of the spectrum from the actual. This 
problem occurs in the computation of spectra for both deterministic as well as ran- 
dom signal. First, we discuss the effects on a finite data of deterministic signal, 
which is easier to observe and then consider random signals. 


171.1 Computation of the ESD 


Let us consider the computation of the spectrum of a deterministic signal from 
a finite sequence of data. The sequence x[n] is usually the result of sampling a 
continuous time signal xq(t) at some uniform sampling rate fs. Our objective is 
to obtain an estimate of the true spectrum from a finite x[n]. 

Recall that if xa (t) is a finite energy signal, that is, 


=f Ixa (t)?dt < oo (17.1) 


then its Fourier transform exists and is given by, 
oo . 7 
Xa(f) = / xate if" dt. (17.2) 
J —00 
From Parseval’s theorem, we have 


E= f Ixa(t)2dt = f IXa(P) Pdf. (17.3) 


The quantity |Xa(f)|? represents the distribution of the signal energy as a 
function of the frequency, and hence is called the energy spectrum density (ESD) 
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of the signal, denoted as Syx( f), which is given as, 
Sxx(f) = [Xa PP. (17.4) 


The total energy (E) in the signal is simply the integral of Syx (f) over all f. 

It is also interesting to note that Syx(f) can be viewed as the Fourier transform 
(FT) of another function r,,(7), the autocorrelation function of the finite energy 
signal xq(t), defined as 


CO 
ryx(t) = f xž(t)xa(t + t)dt. (17.5) 
OO 
Indeed, it easily follows that, 
oo . 
J Pex (te "fdr = Self) = Xa? (17.6) 
J —CO 


so that ryx(t) and Sxx( f) are a Fourier transform pairs. 

Now suppose that we compute the ESD of the signal x(t) from its samples 
(x[n], —co <n < oo) taken at the rate fs (fs > 2B, B is the bandwidth of the 
signal in Hz). We have the FT, 


CO 


X(@) = > x[n]e Jo" (17.7) 
or, equivalently, 
X= $ raj e, (17.8) 


Recall that X (f) can be expressed in terms of Xa (f) as 


X(f)=fe X, Xalf - kf). (17.9) 


k=—0o 


In the absence of aliasing, within the fundamental frequency range |f| < fs/2, we 
have 


X(f) = fsXa(f), fl < fs/2. (17.10) 


Hence the spectrum of the sampled signal is identical to the spectrum of the analog 
signal. As a result, the ESD of the sampled signal is 


Sr (P) = IX (È = FIXA. (17.11) 
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x[n] 


\ 
— 


Tyx[k] Syx (f) 


Figure 17.1. Two ways of estimation of the ESD. 


We can proceed further by noting that the autocorrelation of the sampled signal 


defined by, 


o0 


ry [k] = > x*[n]x[n + k] (17.12) 


n=—OoO 
has the Fourier transform (Wiener-Khinchin theorem) 


o0 


Sxx(f) = P2 rxx[kle i, (17.13) 


k=—0o 


where f = £, fs is the sampling frequency. Hence the ESD can be obtained by 
the Fourier transform of the autocorrelation of sequence x[n]. So, there are two 
distinct methods for computing the ESD of the signal xa (t) from its samples x[n] 
(See Fig. 17.1). One is the direct method, where we compute the Fourier transform 
of x[n] and then 


00 2 


> x[n]e i?i" 


n=— 00 


Sal) = IX? = (17.14) 


The second approach is the indirect method, which requires two steps. First the 
estimation of the autocorrelation ryx[k] using x[n] and then the Fourier transform 
of ryx[k] to obtain the ESD (Eq. (17.13)). 

In practice, however, we have only finite duration sequence x[n], 0 < n < 
N — 1, for computing the spectrum of the signal. In effect, limiting the duration of 
the sequence is equivalent to multiplying x[n] by a rectangular window of length 
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Figure 17.2. Spectrum obtained by convolving an M = 61 rectangular window with the 
ideal low pass spectrum in the example. 


N. Thus we have, 


R x[n] for O<n<N-1 
x[n] = x[n]w[n] = : 
0 otherwise. 
Recall that multiplication of two sequences in the time domain is equivalent to the 
convolution of their spectra in the frequency domain. Hence, 


1/2 


xf) =x(feaw(/)= f _ X@W(f — ada. (17.15) 


Recall from our discussion on filter design (Section 10.3.2) that convolution 
of the window function W (f) with X(f) smoothes the spectrum, provided that 
the spectrum of W ( f) is relatively narrow compared to X ( f). But this condition 
implies that the window w[n] be sufficiently long (i.e., N must be large). More 
over, even if W(f) is narrow compared to X( f), its convolution with the side- 
lobes of W(f) results in side-lobe energy (spectral leakage) in X(f), in frequency 
bands where the actual spectrum is zero. 


Example: A signal with spectrum 


2 1 for |f| < 0.1 
X() = l otherwise. 
is convolved with a rectangular window of length N = 61. The spectra X(f) 
is shown in Fig. 17.2. The width of the main lobe of the rectangular window is 
Aw = 42/61 or Af = 2/61, which is narrow compared to X(f). The energy 
leakage due to the high side lobe levels as well as broadening (smearing) of X (f) 
outside the range (IF| < 0.1) is clearly seen. 
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Figure 17.3. Soectrum obtained by convolving an M = 61 Blackman window with the ideal 
low pass spectrum in the example. 


0 05 f 


Figure 17.4. Two narrow-band signal spectra. 


If we use another window (for example, the Blackman window) instead of the 
rectangular window, the spectrum X(f) will be as sown in Fig. 17.3. Here, the 
leakage has been reduced considerably, however, the spectrum has been widened 
by almost 50%. 

So, the spectral leakage can be reduced by choosing windows that have low 
side-lobes. Though such window functions reduce the side-lobes, they result in 
an increase in smoothing or broadening the spectral characteristics of X ( f). 
This will be a problem in cases where we wish to resolve signals with closely 
spaced frequency components. For example, the signals with spectral character- 
istic X(f) = X1(f) + X2(f), as shown in Fig. 17.4 cannot be resolved as two 
separate signals unless the width of the window function is significantly narrower 
than the frequency separation A Ô. 

It is clear that the ESD of the windowed sequence x[n] is an approximation 
of the desired spectrum of the sequence x[n]. The spectral density obtained from 
x[n] is 


N-1 2 


>. ijnle i?" 


n=0 


Salf) = 1X? = (17.16) 
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The spectrum given by Eq. (17.16) can be computed numerically at a set of N 
frequency points by means of the DFT. Thus (fork = 0, 1,..., N — 1), 


> An ion ( k 
X[k] = >) žine” elaj (17.17) 
n=0 
Then 
2 ; k 
IŽIP = S (Pl pay = Siz (5) (17.18) 
and hence 
N-1 2 
k ‘am k n 
Szz (5) = 2, Fle i2x(%) (17.19) 


which is a distorted version of the true spectrum Syy (4). 
In the next section, we are going to discuss the power spectrum estimation of 
stationary random/stochastic signals. 


17.2 Estimation of the Autocorrelation and Power 
Spectrum of Random Signals: The Periodogram 


The finite energy signals considered in the previous section has Fourier transform 
possible and are characterized by the ESD. On the other hand, the stationary ran- 
dom process do not have finite energy and hence do not possess a Fourier transform. 
Such signals have finite average power and hence are characterized by the power 
spectral density (PSD). If x(t) is a stationary random process, its autocorrelation 
function is, 


Yax (T) = E[x*(t)x(¢ + 1). (17.20) 
The PSD is the Fourier transform of the autocorrelation function’ 
oo . 
Tex (f) =] jat dr (17.21) 
—oo 
In practice, we may have only one realization of the random process from which 


we have to estimate the power spectrum of the process. Also, we do not know 
Yxx(t) and as a result, Eq. (17.21) cannot be computed to obtain T'y,(f). On 


1. By Wiener-Khintchin theorem. 
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the other hand, from one realization of the random process, we can compute the 
time-averaged autocorrelation function, 


T 
Pxx(T) = m EO +r)dt, (17.22) 


where 2Tọ is the observation interval. If the stationary random process is ergodic in 
the mean and autocorrelation function, then 


XxX = li Vx 
yax(t) = lim Frx(t) 


07 CO 
To 
= | *(t)x(t dt. 17.2 
slim on J, O+ (17.23) 


Furthermore, the Fourier transform of Jxx(T) provides an estimate Tyx(f) of the 
PSD, that is, 


R To l 
Pyx(f) = I Fx (te if dr 
-To 


1 To To MD 
p tOst oar] e Jah gy 


~ 21% —To 


To 
[mente l (17.24) 
= > x(t)e 77] dt 17.2 
2To -To 
The actual PSD is the expected value of Ñxx (f) in the limiting case, 
1 | ft l : 
Pyx(f) = lim E | — f x(the i Ftde| |. (17.25) 
To—> 00 2To =T 


From Eq. (17.22) and Eq. (17.24), we see that there are two possible approaches 
to compute T',x(f), the direct method as given by Eq. (17.24) and the indirect 
method, in which first obtain 7,,(t) (Eq. (17.22)) and then compute its Fourier 
transform to find the PSD. 

We shall now consider the estimation of the power spectrum from samples 
x[n] (0 < n < N — 1) ofa single realization of the random process. We assume 
that the signal is sampled at fs > 2B, where B is the highest frequency contained 
in the PSD of the random process. 

The time-averaged autocorrelation sequence is (unbiased estimate) 


N- 1 
> x*[n]xIn +m], m =0,1,...,N—-1 (17.26) 


m— 
n=0 


=a 
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and for negative values of m, we have J! [m] = [7{,[—m]]*. Then we compute 
the Fourier transform 


N-1 7 
LOS > sine (17.27) 
m=—N+1 


The normalization factor N — m in Eq. (17.26) results in an estimate with mean 
value 


l N-m-1 
Elf = — È Etinin + ml] 
n=0 


= yxx[m], (17.28) 


where yyx[m] is the true (statistical) autocorrelation of the sequence x[n]. Hence, 
J} [m] is an unbiased estimate and its variance is approximately,” 


CO 


? N , 
varly,,[m]] ~ ome p2 [ivt +y% [n — m]yxx[n + m]|. 


(17.29) 


oc lyx [7]? < œ. 


Clearly, limy oo var[}/ [m]] = 0 provided that XL% 
Since E[y/,.[m]] = yxx[m] and the variance of the estimate converges to zero as 
N > œ, the estimate y/.[m] is said to be consistent. 

For large values of m, the estimate ĵ/ [m] in Eq. (17.26) has a large variance, 
especially when m approaches N. Because in this case, only fewer number of data 
points are available for the estimate. As an alternative to Eq. (17.26), one could use 


N-m-1 
$ > x*[n]x[n+m] fr0<m<N-1 
n=0 
Yxx[m] = 
N-1 
¥ > x*[n]x[n +m] for m = —1, —2,..., 1- N 
n=|m| 


(17.30) 


N 


This result is given by Jenkins and Watts (Spectral Analysis and its Applications, Holden-Day San Francisco, 
1968). 
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which has a bias of airsal, since its mean value is 


E[ xx a ae i 
[Pam = TA E[x*[n]x[n + m]] 
N — |m |m| 
ey ft = (1 — | cin), 17.31 
wv? [m] ( N)? [m] (17.31) 
However, this estimate has a smaller variance given approximately as (because 
1 N 
N = r= 
~ 1 = 2 * 
varlFaxlml] © D [Demy -myn + m)]. 07.32 
n=—00 


We observe that )yx[m] is asymptotically unbiased, that is vim E[¥xx[m]] = 
> 0o 

¥xx[m] and its variance converges to zero as N — oo. Hence, the estimate 7, [m] 
is also a consistent estimate of yxx[m]. 

We shall use the estimate 7,,[m] (Eq. (17.30)) in our treatment of power spec- 
trum estimation and the estimate of the PSD is 

N-1 E 
e= >) Tabie mm, (17.33) 
m=—(N-1) 
Substituting for 7,,[m] from Eq. (17.30), Eq. (17.33) becomes 


2 


N! ° i 


1 ae 
x >, x[n]e i? fn 


n=0 


yx (f) = 


where X ( 7 ) is the Fourier transform of x[n]. This well-known form of the PSD 
estimate is called the periodogram.’ 

An illustration of the periodogram approach to the PSD estimation of a data 
x[n] of length N samples is provided in Fig. 17.5. 
From Eq. (17.33), the average value of the periodogram estimate [yy (f) is 


N-1 


El (I = E > Felm]e i?" 


m=—(N-1) 


3. Introduced by Schuster (1898) to detect and measure “hidden periodicities” of the data. 
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Figure 17.5. Periodogram approach to the estimation of PSD. 


N-1 - 
= D>)  Elfelmje A" 
m=—(N-1) 
N-1 


> (1 = mI) yxxlm]e 27 Fm (17.35) 


m=—(N-1) 


I 


The interpretation that we give to Eq. (17.35) is that the mean of the estimated 
spectrum is the Fourier transform of the windowed autocorrelation function, 


Pxxtm] = (1 = mI) YxxIm], (17.36) 


where the window function is the triangular (Bartlett) window. Hence 


7 = ce 2 1/2 7 
Elfsx(AI= D, Palme = f „T= @WB (f — a)da 


m=—OO 


(17.37) 


where Wa(f) is the spectral characteristics of the Bartlett window. The relation 
in Eq. (17.37) shows that the mean of the estimated spectrum is the convolution 
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of the true PSD T',x(f) with Wg(f). Hence, the mean of the estimated power 
spectrum is a smoothed version of the true spectrum and it suffers the spectral 
leakage problems. 

We observe that the estimated spectrum is asymptotically unbiased, that is, 


N-1 i o0 i 
glim E|) D falme |= D yalm” = Taf) 
°° | m=-(N-1) m=—0o 


However, in general, the variance of the estimate I’, (f) does not decay to zero 
as N — oo. For example, when the data sequence is Gaussian random process, the 
variance is easily shown to be [5], 


x 2 
= z . sin2a fN 
var [D] = I, 1+{———_.} |, (17.38) 
) f) (: sin £) 
which in the limit as N —> oo, becomes, 
lim var[ D] = T2 (P. (17.39) 
N-> oo 


Hence, we conclude that the periodogram is not a consistent estimate of the true 
PSD (i.e., it does not converge to the true PSD). 


17.21 Summary of the Periodogram based PSD Estimation 


e The estimated autocorrelation y,,[m] is a consistent estimate of the true 
autocorrelation function. 

e Tf f ), the periodogram which is the Fourier transform of ;,[m] is not a 
consistent estimate of the true PSD. 

© Tt is observed that I'y,(f) is an asymptotically unbiased estimate of T yx ( ian 
but for a finite duration sequence, the mean value of Tyx( f ) contains a bias, 
which from Eq. (17.37) is evident as a distortion of the true power spectrum. 

e The estimated spectrum suffers from the smoothing effects and the leakage 
problem thus limiting the ability to resolve closely spaced frequencies. 


17.2.2 Use of DFT in Power Spectrum Estimation 


The estimated ESD, S;<( f ) and the periodogram, Test f ), provided in 
Eqs. (17.16) and (17.34), respectively can be computed by the use of DFT and 
FFT algorithms. If we have N data points, the DFT computation provides samples 
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of the periodogram 


at frequencies fy = x. 

In practice, however, such a sparse sampling of the spectrum does not provide a 
very good representation of the continuous spectrum estimate I’, (f). By padding 
zeros, the effective length of the sequence is increased and the spectrum at other 
frequencies are also can be estimated. Thus, if we increase the length of the sequence 
to L points by zero padding, the L-point DFT is 


2 
> k=0,1,...,L—-1. (17.41) 


N-1 
> “ime o (£) 


n=0 


It may be noted that increasing the data length by zero padding (L > N) 
and computing DFT does not improve the frequency resolution‘ in the spectral 
estimate. It helps us to interpolate the spectral values at more frequency points. 


Example: A sequence of N = 16 samples is obtained by sampling an analog signal 
consisting of two frequency components. The resulting discrete-time signal is 


x[n] = sin(2x (0.145)n) + cos(27 (0.145 + An), n =0,1,...,15, 
(17.42) 


where A f is the frequency separation. Evaluate the PSD, a = wIX(f)P at 
the frequencies fi = k/L, k=0,1,...,L—1 for L = 16, 32, 64, and 256 for 
values of A f = 0.06 and 0.01. 

The evaluated PSD for the given cases are illustrated in Figs.17.6 and 17.7. In 
Fig. 17.6, as you can see, the frequency separation between the two sinusoids is 
Af = 0.06 and hence the DFT spectrum clearly show two peaks closer to the 
actual frequencies of the sinusoids. Increasing the number of points in the DFT 
does not improve the frequency resolvability, however, the spectrum becomes more 
smoother. This is pretty clear in Fig. 17.7, where the frequency separation between 
the two sinusoids is only Af = 0.01. Here, the DFT spectrum fails to resolve 
the two frequencies even though the DFT lengths has been increased to 256. The 
spectrum, however, becomes smoother as in the first case. 


4. Frequency resolution in the spectral estimate is determined by the data length N. 
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f =0.145Hz, Af =0.06Hz, N =16 
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Figure 17.6. Spectra of two sinusoids with frequency separation Af = 0.06. 


fF =0.145Hz, Af =0.01Hz, N =16 
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Figure 17.7. Spectra of two sinusoids with frequency separation Af = 0.01. 
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17.3 Non-parametric Methods for Power Spectrum 
Estimation 


These methods are the classical methods developed by Bartlett (1948), Blackman 
and Tukey (1958), and Welch (1967). These methods make no assumption about 
how the data were generated and hence the name non-parametric. 

Since the estimates are based entirely on finite record of data (N), the frequency 
resolution of these methods is, at best, equal to the spectral width of the rectangular 
window of length N, which is *1/N at the —3d B points. 

First, we describe the estimates and then derive the mean and variance of each. 


17.3.1 The Bartlett Method: Averaging the Periodograms 


For reducing the variance in the periodogram approach, Bartlett suggested this 
method and it involves three steps. 


e The N-point sequence is subdivided into K non-overlapping segments of 
length M. That is, 


x;[n] = x[n + iM], (17.43) 


where, i = 0, 1,..., K — l and n = 0,1,...,M — 1. 
e Compute the periodogram for each segment. 


M-1 2 


> xi [n]e 7}? fn 


n=0 


ENES 1 
PQA =F 
(17.44) 


e Average the periodograms for K segments to obtain the Bartlett power spec- 
tral estimate 


Sec oes ae 
A= <- LIQ. (17.45) 
i=0 


An illustration of these steps in Bartlett method of power spectrum estimation 
is provided in Fig. 17.8. 
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Figure 17.8. Bartlett method to the estimation of PSD. 


Now, the statistical properties of the power spectrum estimates can be easily 
estimated. 


Mean: 


ie ot ee 
EIPR(Pl= Dy ELSI (17.46) 
i=0 
= E(t (f)). (17.47) 


From Eq. (17.35) and Eq. (17.37), we have the expected value of the single 
periodogram as 


Eres > (1-4) yxx[m]e m 
m=—(M-1) 


1 pi? sina(f —a)M : 
M J_ij2 o( sina (f — a) i ee 
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= ' z 2 
where, Wg (f) = u (zie) is the frequency characteristics of the Bartlett 


window.’ 

From Eq. (17.48), we observe that the true spectrum is now convolved with 
Wp (f). The effect of reducing the length of the data from N to M (= X) results 
in a window whose spectral width has been increased by a factor of K. As a result, 
the frequency resolution has been reduced by a factor K. However, the advantage 
is the reduced variance as shown below. 


Variance: 
- : 1 K-1 et ee 
vara = oy > var PQA) 
sA aar 
= goals (A). (17.49) 
If we use Eq. (17.38) in Eq. (17.49), we get, 


a 2 
nuit) 


= (17.50) 
M sin2a f 


var lhe (A) = -i ( 


This means that the variance of the Bartlett power spectrum estimate is reduced 
by the factor K compared to the periodogram approach. 


17.3.2 The Welch Method: Averaging Modified Periodogram 


Welch made two modifications to the Bartlett method: 


e Made the data segments to overlap, which can be represented as (for n = 
0,1,...,M — landi =0,1,...,L — 1): 


xila] = x[n +i D] (17.51) 


where i D is the starting point of the ith sequence. For example, if D = M/2, 
there is 50% overlap between successive data segments. 

e Window the data segments prior to computing the periodogram. The result 
is a “modified” periodogram. 


5. The Bartlett window is given by 


— m = 
wpg[n] = l m for [mi <M—1 


otherwise 
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Figure 17.9. Welch’s method to the estimation of PSD. 
This is illustrated in Fig. 17.9. 
The Welch power spectrum estimate is 
ji. 
PO =— LD) (17.52) 
= 
where, 
. 1 [Mel Pa 
ID = aa 2 x[njwinje"F") , i=0,1,..., L-1 
(17.53) 


where U is a normalization factor for the power in the window function and is 
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Mean: 
L-1 
ETN (fl = DI ETO (fy 
L 


= Er (A). (17.54) 


But the expected value of the modified periodogram is 


į} MIM- 
EPO = Mg È È vinwlm]Eliln; [mye 7}? finm 
n=0 m=0 
| MIM- 
=n 2 5 w[n]w[m]yxx[n — mei? f- ml (17.55) 
n=0 m=0 


Using yxxln] = f1 Trx (a)e}?7 da in Eq, (17.55), we get, 
1 1/2 
EOG = — aw! Py(a) [bb] da 
-1/2 


ee 7 
= f Tyx(a)W(f — a)da (17.56) 
—1/2 


where, 


M-1M-1 


bb = X >. wlnjwlmje—P2 namS- (17.57) 


n=0 m=0 


in z |2 
and by definition W (f) = we baer 0 l wf[n]e7?=f”| . The normalization factor 


U ensures that [iW Aaf = sl 


Variance: 
L-1L-1 
var P(A) = 75 SEY ELARG- ERMA? 07.58) 
i=0 j=0 


In the case of no overlap between successive data segments (i.e., L = K), Welch 
has shown that 


var [X (f)] = portend 


a (f). (17.59) 
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In the case of 50% overlap between the data segments (L = 2K), the variance 
of the Welch power spectrum estimate with the Bartlett window is shown to be [5] 


var[ Y (f)] © x T? AP). (17.60) 


17.3.3 The Blackman and Tukey Method: Smoothing 
the Periodogram 


In this method, the sample autocorrelation sequence is windowed® first and 
then Fourier transformed to give the estimate of the power spectrum. Thus, the 
Blackman- Tukey (BT) estimate is 


M-1 


Pe A)= X falmwfme im (17.61) 
m=—(M-1) 


where the window function w[n] has length 2M — 1 and zero for |m| > M. With 
this definition of w[n], the limits on the sum in Eq. (17.61) can be extended to 
(—00, 00). Hence the frequency domain equivalent expression for Eq. (17.61) is 
the convolution integral 


1/2 7 
rar (f) = l.. T,.(a)W(f —a)da (17.62) 


where Ñ., (f) is the periodogram. It is clear from Eq. (17.62) that the effect of 
windowing the autocorrelation is to smooth the periodogram estimate, thus decreasing 
the variance in the estimate at the cost of reducing the resolution. An illustration 
of the proposed method is provided in Fig. 17.10. 

The window function w[n] should be symmetric (even) about n = 0 to ensure 
that the estimate of the power spectrum is real. Furthermore, it is desirable to select 
the window spectrum to be non-negative, that is, w(f)> 0, |f| < 1/2. This 
condition ensures that the estimated spectrum TET (F) > 0 for |f| < 1/2, which 
is a desirable property of any spectral estimate. 


Mean: 
PBT; ¢ Me rn ra 
eter (p= f elf. (@1w(f - ada, (17.63) 
J—1/2 
6. The rationale for windowing 7x[m] is that, for large lags, the estimation are less reliable because a smaller 


number (N — m) of data points enter the estimate. For m — N, the variance of jx[m] is very high and 
hence the estimates should be given less weighting. 
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Figure 17.10. Blackman and Tukey method to the estimation of PSD. 


Substituting for E ibs (a)] (from Eq. (17.37)) in the above equation, we get the 
double convolution integral 


7 ie p1/2 7 
etter i= [ f Tax(0)Wg(a —0)W(f —a)dadd. (17.64) 
-1/2 J —1/2 


Equivalently, in the time domain, the expected value is 


M-1 
EIR I= Š Elfelmlwfm]e i?" 
m=—(M-1) 
M-1 7 
= >) pexlmwglm|wlmje 77" 
m=—(M-1) 
(17.65) 


where wg[n] is the Bartlett window. Clearly, the length of w[n] should be such 
that M < N. That is, w[n] should be narrower than wg[n] to provide additional 
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smoothing of the periodogram. Under this condition, Eq. (17.64) becomes,’ 


1/2 - 
EDET (DI ~ sf Tax (0)W (ÔF — 0)d0. (17.66) 


The mean of the PSD estimate using Blackman and Tukey method is a 
smoothed PSD. 
Variance: The approximate expression for the variance is given by [5], 


var[ BT AI~ F2,(f) È i word | 
F N 
—1/2 
1 M-1 
xT? (f) > wn]. (17.67) 
m=—(M-1) 


The following table gives an overview of the mean and variance of the power 
estimates using the different non-parametric methods discussed in this section. 


Method Mean Variance 
; z 2 
‘ 0. z hi in 
Periodogram a Txx(a)Wg(f — a)da r2 (A f + (H24) | 
i z 2 
0.5 z z in2z fN 
Bartlett ty Sos Tx (0Wgl F -ada 4r A |1 (2E) | 
Welch ee Tyx(a)W(f — a)da x i rf) (no overlap) 


Blackman f°} Tre(a)W(f-ada TA [7 Seis W2)a8| 
& Tukey 


17.3.4 Performance Characteristics of Non-parametric Power 
Spectrum Estimates 


The quality of the Bartlett, Welch, and Blackman and Tukey power spectral esti- 
mates are compared by using the ratio of the square of mean of the power spectrum 
estimates to its variance as shown in the equation below: 


_ (Era Ay? 


= 6 
var (TA P] aie 


7. Since f, Wa (a — 0)W(f — a)da = Jl", We(a)W(f - 0 — a)da ~ W(f - 8). 
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where, A = B, W or BT for the three power spectrum estimates. Table below 
shows this comparison. It also shows the FFT based computational requirement for 
each of these methods. Here N is the length of the data and A Ô is the frequency 
resolution (measured at the —3d B point). 

Asymptotically, the periodogram is characterized by the quality factor 


Tif) _ 4 
TR) 


It is fixed (= 1) and independent of data length N (another indication of poor 


P= (17.69) 


quality of power spectrum estimation using periodogram). 


Computational 
Methods Quality Factor Requirements (FFT) 
F N 0.9 
Bartlett 1L1I1NAf + log, eG 
Welch ( 50% overlap) 1.39NA f N log, aF 
Blackman-Tukey 2.34NA f N log, F 


We end the non-parametric methods of power spectrum estimation here. In the 
next section, the some of the modern (parametric) methods of power spectrum 
estimation are discussed. 


17.4 Parametric Methods for Power Spectrum Estimation 


The non-parametric methods for the power estimation are relatively simple, well 
understood, and easy to compute using DFT or FFT. However, they have the fol- 
lowing limitations: 


e They require long data records to get better frequency resolution. 

e They suffer from spectral leakage due to windowing. This often masks the 
weak signals that are present in the data. 

e The inherent assumption that the autocorrelation estimate xx [m] is zero for 
m > N (where N is the data length) is unrealistic. This assumption limits 
the frequency resolution and the quality of the power spectrum estimate. 

e The inherent assumption that the data are periodic with period N in the 
periodogram estimate is unrealistic. 


The parametric methods do not require such assumptions. In fact, these meth- 
ods extrapolate y;,[m] form > N. Extrapolation is possible if we have some a 
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priori information on how the data were generated. Hence, a model for the signal 
generation is constructed using a number of parameters from the observed data. 
The model and the estimated parameters are then used to compute the PSD. The 
modeling approach eliminates the need for windowing and hence avoid the spec- 
tral leakage which provides a better frequency resolution compared to the FFT 
approach. This is especially better for time-varying or transient process where the 
data length (N) is very short and limited. 

The parametric methods are based on modeling the data sequence x[n] as the 
output of a linear system characterized by a rational system function of the form 


BQ) Do bez 


A(z) = = : (17.70) 
@) AZ) Tae are” 
The corresponding difference equation is 
p q 
x[n] = -> agxin =k] + Š bwin — k], (17.71) 
k=1 k=0 


where w[n] is the input sequence to the system and x[n] is the output of the system 
which is observable. 

If x[n] is characterized as stationary random process, then w[n] is also assumed 
to be stationary random process and hence the PSD of the data is 


Lal = IHAT vov, (17.72) 


where Fww(f) is the PSD of w[n] and H(f) is the frequency response of the 
model. 

Since our objective is to estimate T yx ( f ), it is convenient to assume that w[n] 
is zero mean white noise sequence with autocorrelation yww[m] = o2 dim], where 
a = E[|w[n]|*] is the variance. Then, 


a IB(AYI? 
ADI 


So, in the model-based (Parametric) approach, the spectrum estimation proce- 


Lax) =o, 2 Se (17.73) 


dure consists of two steps. First, from the data sequence {x[n]},0 <n < N —1, 
estimate the parameters {ax} and {by} of the model. Then, from these estimates, 
compute the power spectrum according to Eq. (17.73). 

It may be noted that the random process x[n] generated by the pole-zero model 
in Eq. (17.70) or Eq. (17.71) is called an ARMA process of order (p,q) and is 
denoted as ARMA(p, q). If q = 0 and bo = 1, the resulting system model has a 
system function H(z) = 1/A(z) and its output x[n] is called an AR(p) process. 
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The third possible model is obtained by setting A(z) = 1, so that H(z) = B(z). 
The output of this system is called a MA(q) process. 

Before describing the methods for estimating the parameters in AR(p), MA(q), 
and ARMA(p, q) models, it is useful to establish the relationship between the 
model parameters and the autocorrelation sequence yxx[m]. In addition, we relate 
the AR model parameters to the coefficients in a linear predictor (LP) for the pro- 
cess x[n]. 


17.4.1 Relationships Between the Autocorrelation 
and the Model Parameters 


For the ARMA(p, q) process, the relationship is given by [5], 


p 
a a akyxx[m — k] for m > q 
k=1 
_ p 
Yexlm] = | _ > akyxx[m — k] + oo Dio Ak itm for 0<m<q 
k=1 
Vexl—m] for m <0. 


(17.74) 
From Eq. (17.74), form > q, the set of linear equations for determining the 
model parameters {ax} are 


ai Yxxlq + 1] 
a2 Yxxlq +2] 
(AA)| . |=- . (17.75) 
ap Yxxl4 + p] 
where 
Yxxlq] yxxlq — 1] .-- Yxxlg — p+ 1] 
xxl +1] xxl ] see XX = +2 
ise Felg Yexld m te Pe) 
Yxxlg + p — 1] Yxxlg + p — 2] tee Yxxlq] 


An interpretation of the relationship in Eq. (17.75) is that the values of the auto- 
correlation yxx[m] form > q are uniquely determined from the pole parameters 
{ax} and the values of yxx[m] for O < m < p. Hence, the linear system model 
automatically extends the values of yxx[m] for m > p. 

The {ax}’s obtained from Eq. (17.75) will not help in determining the MA 
parameters {bx} as it requires the knowledge of the impulse response h[n]. 

If we adopt an AR(p) model for the observed data, the relationship between 
the AR parameters and the autocorrelation is obtained form Eq. (17.74) by setting 
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q = 0. Thus we get, 


p 
akYxx[Mm — k] for m > 0 
k=1 


p 
— > agyxxim — k] +02 for m=0 (17.76) 
k=1 


Yxx [m] = 


vel re] for m <0. 


In this case, the AR parameters are obtained from the solution of the Yule- Walker 
or normal equations (shown below). 


¥xx[0] ¥xx[—1] .-- Yxxl-—p + 1] di Yxx[l] 
Yxx[l] Yxx [0]... Yxxl—p + 2] a2 _ Yxx [2] 
¥xxlp — 1] yxx[p — 2]... xx [0] ap YxxLP] 
(17.77) 
and the variance can be obtained from ( Eq. 17.76, m = 0) 
P 
o2 = yxx[0] + X akyrx[—k] (17.78) 


k=1 


Usually, Eqs. (17.77) and (17.78) are combined into a single matrix equation as 


PaslO] yexI-1] > yxxl-p] 1 os 
¥xx[1] ¥xx[0] .-- Yxxl -P + 1] di 

| i As (17.79) 
YxxlP] yxxlp — 1]... Yxx[0] ap 0 


It may be noted that the correlation matrix in Eq. (17.79) is Toeplitz,*® and it can 
be efficiently inverted using the Levinson-Durbin algorithm.’ 

Thus all the system parameters in the AR(p) model are easily determined from 
the knowledge of the autocorrelation sequence yxx[m] for 0 < m < p. Further- 
more, Eq. (17.76) can be used to extend the autocorrelation sequences beyond 
m > p, once the {ax} are obtained. 


8. For a Toeplitz matrix, we have Aj,; = Ai—1,j—1, where A;,j is the (i, j)” element of A. 


9. This is a computationally efficient recursive algorithm for estimating the model parameters. 
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For the MA(q) model for the observed data, the relationship between the auto- 
correlation and {bx} are given by [5] 


oX _obkbk4m for 0S meg 
Yaxlm] = 0 for m >q (17.80) 
yè [>m] for m <0. 


17.4.2 AR Method of Power Spectrum Estimation 


In this method, first estimate the AR parameters and then the power spectrum can 
be estimated. 
17.4.21 Yule-Walker Method of AR Power Spectrum Estimation 


In this method, the biased estimate of the autocorrelation (Eq. (17.81)) is used 
to ensure that the matrix is positive semi-definite and hence to ensure stable AR 


model. 
l N-m-1 
Yxx[m] = a 2 x*[n]x[n +m], m > 0. (17.81) 


The Levinson-Durbin algorithm [10] can be used to recursively estimate the 
model parameters. The corresponding power spectrum estimate is 
x2, 
Twp 
[1 + Xg @plkle— I?" fk]? 


P= (17.82) 
where âp[k] are the estimates of the AR parameters obtained from the Levinson- 
Durbin recursion and 


p 
Gap = Ef = faxl0] [ | [1 - 1aplea?| (17.83) 
k=1 


is the estimated minimum mean-square value for the pth order predictor. 


17.4.2.2 The Burg Method of AR Power Spectrum Estimation 


The major advantages of Burg’s method are high frequency resolution, stability, 
and computational efficiency [10]. This method is based on the minimization of 
the forward and backward errors in linear predictors, with the constraint that the 
AR parameters satisfy the Levinson-Durbin recursion. 
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From the available data x[n], n = 0,1,..., N — 1, let us consider the forward 
and backward linear prediction estimates of order m, given as 


ŝin] = — Do an lk lxin — k] (17.84) 
k=1 

&[n —m] = — > ah tkix[n +k — m] (17.85) 
k=1 


where dm[k],0 < k <m—1,m=0,1,..., p, are the predictor coefficients. The 
corresponding forward and backward prediction errors are fm[n] = x[n] — x[n], 
and gm[n] = x[n — m] — x[n — m], respectively. The least-squares error that is to 
be minimized to estimate the prediction coefficients subject to the constraint that 
it satisfies the Levinson-Durbin recursion is 


N-1 


em = >> [Ifat + Lgl]. (17.86) 


n=m 
The Levinson-Durbin recursion is given by (for 1 < k < m — 1 and 
l<m<p), 


Amlk] = am—1[k] + Kma,,_,[m — k] (17.87) 


where Km = Gm[m] is the mth reflection coefficient in the lattice filter realization 
of the predictor. The minimization of €m with respect to the complex-valued Kin 
results in (form =1,2,..., p), 


enon Pillay ale 
"TSX fn ifn? lgm- 12] 


(17.88) 


The term in the numerator of Eq. (17.88) is an estimate of the cross-correlation 
between the forward and backward prediction errors. With the normalization factor 
in the denominator, it is apparent that Km < 1, so that the all-pole model obtained 
is stable. 

We note that the denominator in Eq. (17.88) is simply the least-squares esti- 
mate of the forward and backward errors, EÍ and E? j; respectively. Hence 
Eq. (17.88) can be expressed as (for m = 1,2,..., p) 


x a ee gin | 
Kin = Enam Í iln]g,,_\" l (17.89) 


1| ef rb 
2 [i + BP | 
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where Êl + Éb i= Ê, is an estimate of the total squared error Em. It was 
shown that the denominator term in Eq. (17.89) can be computed in a recursive 
fashion A to [10] 


Em = (1- Inl? Êm- 1— |fm-ilm — 1] J? — 18m—1|m — ai (17.90) 


To summarize, the Burg algorithm computes the reflection coefficients in the 
equivalent lattice structure as specified by Eqs. (17.89) and (17.90), and the 
Levinson-Durbin algorithm is used to obtain the AR parameters. The power spec- 
trum estimate is, 


A 


Ep 
[1+ Py Gplk le 72 Fe 
17.4.2.3 Selection of AR Model Order (p) 


2U (f) = (17.91) 


How do we choose the value of p? Too low an order result in a highly smoothed 
spectrum and too high a value introduce spurious peaks in the spectrum. The mean- 
square value of the residual error (G2) can be used as a measure to choose an 
optimum model order. The characteristics of this error is that it decreases as the 
model order increases. We can monitor the rate of decrease and decide to terminate 
the process when the rate of decrease becomes relatively slow. 

Some of the popular methods are: 


© Akaike’s final prediction error (FPE) criteria, where the order is selected to 
minimize the performance index 


(17.92) 


N+p+1 
FPE(p) = ô2, ( ) 


N-p-l1 


where G2 , is the estimated variance of the linear prediction (one-step) error. 


wp 
© Akaikes Information Criteria (AIC), based on selecting the order that 
minimizes 
2 
AIC(p) = Indy + (17.93) 


Note that 62 p decreases and therefore 1n ô ao. also decreases as p increases. 
Op 


However, 47 increases in p. Hence, a minimum value is obtained for some 
p. 

e Rissanens Minimum Description Length (MDL) criteria, where MDL is 
defined as 


MDL(p) =NIné2, + pInN. (17.94) 


wp 
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© Parzen’s Criterion Autoregressive Transfer (CAT), defined as 


i 1 1 
CAT(p) -(j Vs )- roe (17.95) 


where 


= a2 
Ook = NK YKE (17.96) 


The order p corresponding to the minimum of CAT (p) is to be chosen as 
the AR order. 
17.4.3 MA Model for Power Spectrum Estimation 


The parameters in an MA(q) model are related to the statistical autocorrelation 
yxx[m] by Eq. (17.80). However, 


q 
BOBE ')=D@= >) da” (17.97) 


m=—q 
where the coefficients {dm} are related to the MA parameters by [5] 


q—|m| 
dm = >) bkbk4m, m| <q. (17.98) 
k=0 


Clearly, then (from Eq. (17.80)), 


o2dm for |\m| <q 


Yxxlm] = (6 for |m| > q (17.99) 
and the power spectrum for the MA(q) process is 
~ q 7 x 
r=) wane. (17.100) 


m=—q 


It is clear from these equations that we do not have to solve for the MA param- 
eters {bx} to estimate the power spectrum. The estimate Jxx[m] for |m| < q is 
enough. From such estimates, we can compute the MA power spectrum, given by 


4 S 
PACH) = > Pexlmle 27 F™, (17.101) 


m=—q 
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§ An alternative method for determining {bx} is based on a high order AR approximation 
to MA process. 


The order g of the MA model may be determined empirically by AIC as 
described in the previous subsection. The criteria is to choose the order which gives 
the minimum of 


AIC{q] =Iné2,, + (17.102) 


where Gay is an estimate of the variance of the white noise. 


17.4.4 ARMA Model for Power Spectrum Estimation 


The ARMA model is particularly appropriate when the signal has been corrupted 
by noise. For example, suppose that the data x[n] is generated by an AR system, 
where the system output is corrupted by white noise. The z-transform of the auto- 
correlation of the resultant signal can be expressed as 


2 


a. 
Dal) = ——*—- +0? 
ave JAG = 
2 —1 
A(z)A 
_ Toto ee ) (17.103) 
A(zZ)A(z™) 
where o2 is the variance of the additive noise. Therefore the process x[n] is 


ARMA(p, p), where p is the order of the AR process. 

From Eq. (17.75), for lags |m| > q, the equation involves only the AR param- 
eters. Using the estimates of y,,[m], we can solve Eq. (17.77) to obtain dg. For 
high-order models, however, this approach is likely to provide poor estimates of 
the parameters because of the poor estimates of the autocorrelation values at larger 
lags. Hence, this method is not recommended. 

A more reliable method is to construct an over-determined set of linear equa- 
tions form > q, and to use the method of least-squares [14]. To elaborate, suppose 
the autocorrelation (yxx[m]) can be accurately estimated up to lag M > p +q. 
Then, we can write the following set of linear equations: 


ay yxxl¢g + 1] 


XX +2 
CC en Isast ss (17.104) 


ap Yxx[m] 
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where 
yxxlq] Yxxlq = 1] «-. yxxlg-p+1] 
Ah Pxsla + 1 Pxxlą] = Yex(q — P+?) 
Yxx[M — 1] Yyxx[M —2] ...  Yxx[M — p] 
or equivalently, 
Rixa = —ryx (17.105) 


where R,, is the matrix of autocorrelations, ry, is the vector of autocorrelations, 
and a is the vector of AR parameters. 

Since the autocorrelation matrix R,, is of dimension (M — q) x p, and M — 
q > p, we can use the least-squares criterion to solve for the parameter vector a. 
The result is, 


a= —(RI Rxx) RY tex (17.106) 


This procedure is called the /east-squares modified Yule- Walker method. A weight- 
ing factor can also be applied to the autocorrelation sequence to deemphasize the 
less reliable estimates for large lags. 

Once the parameters for the AR part of the model have been estimated as indi- 
cated above, we have the system 


p 
AQ@) =14+ > a. (17.107) 


The sequence x[n] can now be filtered by the FIR filter A(z) to yield the 
sequence 


p 
vin] = x[n] + È âx[n — k], n=0,1,...,N—1. (17.108) 
k=1 


The cascade of the ARMA(p, q) model with A(z) is approximately the MA(q) 
process generated by B(z). Hence we can apply the MA estimate given in the pre- 
ceding section to obtain the MA spectrum. To be specific, the filtered sequence 
v[n] for p < n < N — 1 is used to form the estimated correlation sequences 
Pv [M], from which we obtain the MA spectrum 


q ~ 
wea Gi) = > Too [m], (17.109) 


m=—q 
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Finally, the estimated ARMA power spectrum is 


i) 
I1 + SP ape I? Fk? 


ree) = (17.110) 


The order (p, q) of the ARMA model can be selected by using the following 
AIC index: 
2(p +4) 


p (17.111) 


where ô oq is an estimate of the variance of the input error. 


17.5 Discrete-Time White Noise 


In Chapter 15, we studied about continuous-time white noise. In this section, we 
shall study about discrete-time white noise. A discrete-time signal x[n] is said to be a 
white noise if its power spectrum is flat over the complete frequency range. That is, the 
power spectrum is given by 


Lal f) = o? —0.5 < f < 0.5. (17.112) 


Here, f denotes the normalized frequency. Since x[n] is a discrete-time signal, its 
power spectrum T yx( f) is periodic with period equal to I (i.e., normalized sampling 
frequency). Consequently, the power of x[n] is given by, 


0.5 
Px e Tix(f)df = o2. (17.113) 
—0.5 
Taking the inverse DTFT of the power spectrum, we get the autocorrelation of 
x[n] as 
yxx[m] = x[n]x[n +m] = o2 5[m] (17.114) 
This implies that 


o? if m=0 


Yxxlm] = rk if m £0. (17.115) 


where m is an integer. Thus, the samples of a discrete-time white noise are com- 
pletely uncorrelated with each other. Equation (17.112) requires that the mean of 
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x[n] must be zero. Therefore, for discrete-time white noise, we have 


Power spectrum, I, (f) = o? for all f (17.116) 
Autocorrelation, yxx[m] = o?ô[lm] (17.117) 
Mean, mx =0 (17.118) 

Power, Px = |x[n]|2 = o? (17.119) 

Variance, o? = |x[n] = m|? = Px. (17.120) 


Thus, while the continuous-time white noise is an idealistic signal that does not 
exist in practice (nor can it be physically generated), the discrete-time white noise 
can be generated." 


17.6 DFT for Spectrum Estimation 


In Chapter 12, we introduced the discrete Fourier transform (DFT) as a practical 
tool for estimating the spectra of signals. Recall the following from our study on 
DFT. 


© The DFT computes the spectrum at discrete frequencies, which are equally spaced, 
based on finite data records. The spacing between the frequencies are given by 
1/N where N is the length of the data record. 

© The DFT treats the finite data record {x[0], x[1], x[2],--- , x[N — 1]} as one 
period of a periodic signal with period N. 

© The DFT spectrum, X[k], is equivalent to sampling the DTFT spectrum, X (f), 
of the finite data record {x[0], x(1), x(2),--- , x[N — 1]} at frequencies given 
by0, 1/N, 2/N, +++, (N —1)/N. 

© The DFT ofa sinusoidal signal will indicate the actual frequencies of the sinusoids 
only if the normalized frequencies of the sinusoids fall exactly on the frequencies 
at which the DFT is evaluated. 


Thus, when we use DFT to do spectrum estimation, we must know how the period- 
icity assumption of DFT and the value of N affect the estimated spectrum. There- 
fore, in the following sections, the objective is to throw light on the various trade-offs 
that result from the periodicity assumption in DFT and the choice of N. 


10. Let the power of a discrete-time white noise be oe and let the underlying sampling frequency be f;. Then, 
in terms of un-normalized frequency, the power spectral density of the discrete-time white noise is given by 


of /fs 
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By studying these sections, we should be able to receive clarity and understanding 
on the following. 


e Why windows are required in spectrum estimation? Which are the typical 
window functions? 

e How does the choice of the window function and the value of N control the 
trade-off between spectral resolution and spectral leakage? 

e When should leakage be given priority over resolution? 

e How does the choice of N affect frequency and time resolutions? 

e Issues that underlie spectral smoothing. 


17.7 Windows and Spectrum Estimation 


Let x[n] denote the samples of a continuous-time signal of very large duration. In a 
particular experiment, we capture N samples of this signal and are given by 


y[n] = x[n] for n=0,1,...,N—1. (17.121) 


We can also express the measured signal as 


yin] = x[n]w[n] (17.122) 
where 
jaa Pa (17.123) 
0O otherwise 
is known as a rectangular window of duration N. Thus, we find that 
a= x[n] for A= OA sang I (17.124) 
0 otherwise 


Thus, the window function makes y{n] to be zero outside the time-span of the window. 


17.71 Periodicity Assumption of DFT 


Using Eq. (17.122), we can express the spectrum (DTFT) of y[n] as 


0.5 
Y( =xX(f\o wf) a XWW = du. (17.125) 
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Figure 17.11. Illustration of windowing on the computed spectrum of a complex sinusoid 
at normalized frequency 0.4. (a) ECF) is the actual spectrum of the complex sinusoid, 
(b) W(f) is the spectrum of the rectangular window for length N = 25, and (c) Y(f) = 
wf — 0.4) is the computed spectrum of the complex sinusoid based on N = 25 samples. 
All the spectra are computed using the expression of DTFT. 


For the sake of illustration, we choose x[n] = e/27/1", i.e., a complex sinusoid at 
normalized frequency fı. Then, we have 


x[n] = effin and = X(f) =d(f — fi). (17.126a) 


Using Eq. (17.126a) in Eq. (17.125), we get 


0.5 
Y(f)= a P ôlu — fi)W(f — u)du = W(f — fi). (17.126b) 


Thus, because of the finite data effect, the spectrum of the complex sinusoid computed 
based on N samples is given by the shifted spectrum of the window. That is, instead of 
an impulse sitting at f = fi as the signal spectrum, the finite data effect causes the 
spectrum to take the shape of the window spectrum. This is illustrated in Figure 
17.11 for fi = 0.4 and a rectangular window of length N = 25. 

The spectrum of the rectangular window is given by 


[oe] 7 N-1 7 
WA = >> wnet” = $ wine?” 
n=—0o n=0 
_ jan fN N 
= = s elt N- psina ÎN) (17.127) 
1 — ej?r f sin(x f) 


Therefore, the pa of |W(f)| occurs at f = 0 and the zero- crossings of |W ( DI 
occur at f = $ 4 for non-zero l = +1, +2, . 
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Figure 17.12. Illustration of the effect of periodicity and choice of N onthe DFT spectrum 
for the spectrum of a complex sinusoid at normalized frequency 0.4. (a) DTFT Y(f) com- 
puted for N = 10, (b) DFT Y computed for N = 10, (c) DTFT Y(f) computed for N = 11, 
(d) DFT ¥ computed for N = 11. 


Since DFT is obtained by sampling the DTFT at f = x, we get 


Y[k] = Y =W ee: 

[k] = (=) = (5 fi) 
B jn(N-1)(#-Ai) sin(x (k — N f )) 
=e 


= (17.128) 
sin(æ (k — N fi)/N) 


Therefore, ¿fN is chosen such that N fi is an integer (in the range 0, 1,..., N — 1), 
then we will find that 


W[0] for k=Nf; 


~ 17.12 
0 for k# Nfi. RN 


IY[k]| = | 
For the complex sinusoid at fi = 0.4and N = 10, we have N fi = 4. Therefore, 
the DFT spectrum will contain a peak at k = 4 and will be zero for all other values 
of k = 0,1, 2,3,5, 6, 7, 8, 9. This is shown in Fig. 17.12 using the red ‘o’. 
On the other hand, if we choose N such that N fi is not an integer in the range 
{0,1,..., N — 1} (e.g, N = 11), then the DFT will be given by 


sin(x (k — N f1)) 
sin(x (k — N fi)/N) 


IY[k]| = forall k (17.130) 


and it will be non-zero for most values of k. This is shown in Figure 17.12 using 
the blue ‘©’ for the corresponding frequencies k/N, k = 0, 1,..., N — 1. 
Based on this, we have the following remarks. 


© The choice of N determines the frequencies at which DTFT is evaluated and 
hence the shape of the resulting DFT spectrum. 
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Figure 17.13. Illustration of the effect of periodicity and choice of N in the time-domain 
signal for a complex sinusoid at normalized frequency 0.4. (a) y,[n] is the periodic exten- 
sion of y[n] for N = 10, (b) y2[n] is the periodic extension of y[n] for N = 11. 


© When N is chosen such that the periodicity assumption is satisfied, the DFT spec- 
trum will correspond to the actual spectrum (see Eq. (17.129)). 

© When N is chosen such that the periodicity assumption is not satisfied, the DFT 
spectrum will behave according to the sampled spectrum of the window given by 
Eq. (17.130). 


Figure 17.13 shows the periodic signals generated using the finite-date 
records of y[n]. The signal y,[n] is obtained by periodically extending 
{y[0], y[1], --- , y[9]}, i.e., with N = 10. The signal y2[7] is obtained by periodi- 
cally extending {y[0], y[1],--- , y[10]}, i.e., with N = 11. Observe that yı [7] fol- 
lows the original sinusoid while y2[n] does not resemble a sinusoid. Consequently, 
the DFT spectrum resulting from N = 11 will not resemble that of a sinusoid. 
Thus, we can see the agreement between Figs.17.12 and 17.13. 


17.7.2 Spectral Leakage 


Observe from Eq. (17.126b), i.e. Y(f) = W(f — fi), and Figure 17.11 that the 
computed spectrum, Y(f), of the sinusoid based on N samples has the shape of 
the window spectrum. That is, the finite data effect causes the impulse spectrum of the 
sinusoid to spread to all the frequencies. This effect is known as spectral leakage. The 
amount by which the impulse at f = fi leaks to the other frequencies depend 
upon the shape of the window spectrum W (f). For example, the leaked spectrum 
at frequency f = 0.46 is given by W (0.46 — Fi): 

Clearly, we would prefer to minimize the leakage. This can be achieved by choos- 
ing the window function such that its side-lobe levels are low. Figure 17.14 shows 
the spectra for typical window functions with N = 10. We can observe the follow- 
ing from Fig. 17.14. 
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Figure 17.14. Time domain and frequency domain characteristics of different window 
functions: (a) Rectangular, (b) Hamming, (c) Hanning, and (d) Blackman. 


e The rectangular window has the minimum main-lobe width. But it also has 
the highest side-lobe height. 

e The Blackman window has the lowest side-lobe height. But it also has the 
widest main-lobe. 

e The main-lobe width and side-lobe height of Hamming and Hanning win- 
dows lie intermediate to that of rectangular and Blackman windows. 


Figure 17.14(a) shows the time-domain plots of these window functions. 
Observe that while rectangular window causes the sharpest truncation at the bound- 
aries, the Blackman window results in the smoothest truncation at the boundaries. This 
is why, the spectra of these two windows have the opposite characteristics as high- 
lighted above. 


§ Based on the side-lobe levels of the different windows shown in Fig. 17.14, we see that 
the rectangular window results in maximum spectral leakage, while the Blackman window 


results in minimum spectral leakage. 


17.7.3 Spectral Resolution 


Spectral resolution refers to the ability of the spectral estimator to resolve closely 
spaced spectral lines (frequencies). For example, consider the following signal 
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(a) fi =0.3, fo = 0.42, a, =a, =1 
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Figure 17.15. Spectra of the sum of two complex sinusoids (equal powers) using rectan- 
gular and Blackman windows with N = 50, Aj = 1 and A = 0.1. (a) (fi, f2) = (0.3, 0.42), 
(b) (fi, J2) = (0.3, 0.35). 


obtained by summing two complex sinusoids of amplitudes A; and A2 and fre- 
quencies fı and fo: 


x[n] = Aiel Än 4. Apei hn, (17.131) 


When we use a spectral estimator to compute the spectrum of x[n], we expect 
to see two spectral lines corresponding to the two sinusoids. But will the spectral 
estimator be able to show these two spectral lines even if the frequencies fy and 
fr are very close? To answer this, we need to study the resolution capability of the 
underlying spectral estimator. 

Figure 17.15 shows the spectra of x[n] for two sets of values of the frequencies. 
Figure 17.15(a) corresponds to fi= = 0.3 and f= = 0.42, and Figure 17.15(b) 
corresponds to fj = 0.3 and fy = 0.35. The amplitudes of the sinusoids are 
set to be equal: Ay = 1 = A2. The selection of frequencies correspond to wide 
separation of spectral lines in Case (a) and closely spaced spectral lines in Case 
(b). We use rectangular and Blackman windows (with N = 50) to illustrate the 
difference in the resolution capability for different windows. 

Observe that while the rectangular and Blackman windows are able to resolve 
the two spectral lines clearly in Case (a), the Blackman window fails to resolve the 
spectral lines in Case (b). This is because the main-lobe of Blackman window is 
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(a) fi =0.3, fo = 0.42, a; = 1,àz = 0.1 
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Figure 17.16. Spectra of the sum of two complex sinusoids (unequal powers) using rect- 
angular and Blackman windows with N = 50, A; = 1 and Az = 0.1. (a) (fi, f) = (0.3, 0.42), 
(b) (fi, J2) = (0.3, 0.35). 


too wide to be able to resolve the closely spaced sinusoids in Case (b). Because 
rectangular window has narrow main-lobe, it is able to resolve the lines in Case (b). 

Figure 17.16 shows the spectra of x[n] when the amplitudes are chosen as 
A, = 1 and Az = 0.1. The frequencies and N are the same as that in Fig. 17.15. 
Observe that, compared to Fig. 17.15, the resolution provided by rectangular win- 
dow in Fig. 17.16 is poor compared to that of Blackman window. This can be very 
clearly seen for Case (a). This arises because of the high spectral leakage caused by 
rectangular window compared to the Blackman window. Thus, when we have sig- 
nals that consist of a mixture of strong and weak spectral components, we should 
give importance to minimizing spectral leakage. Otherwise, the weak component 
may get suppressed by the leakage arising from the strong component. Conse- 
quently, we prefer to use Blackman or Hamming type windows in such situations, 
compared to the rectangular window. 

The phenomenon of spectral leakage and its effect on spectral resolution, as 
manifested in Figs.17.15 and 17.16, can be seen clearly from the following. Using 
Eg. (17.126b), we can write the DTFT of x[n] (given in Eq. (17.131)) as 


x(f) = [Arf - fi) + Arf - fy] 0 WA) 
=A,W(f — fi) + AoW(f — P). (17.132) 
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Therefore, we get 


X(fi) = A.W) + AoW(fi — fr) (17.133) 
X(f) = AiW(fo — fi) + A2W (0). (17.134) 


Thus, we see that the spectrum at f = fi is influenced not only by the main- 
lobe associated with the sinusoid with frequency fi G.e., A, W[0]), but also by 
the side-lobe associated with the sinusoid of frequency fo (ie, A2W(fi — f2)). 
A similar phenomenon happens for the spectrum evaluated at frequency fz (see 
Eq. (17.134)), and for all the frequencies. This is illustrated in Fig. 17.17 which 
shows the spectra W(f — fi) and W(f — fo), with (fi, f2) = (0.30, 0.42) and 
Aj =A2.=1. 

If the side-lobe level of a window is very low (see Fig. 17.17(b)), then the spec- 
trum estimated at each frequency will be dominated by the contribution from the 
main-lobe, leading to a better spectrum estimate. On the other hand, if the side- 
lobe level is high (see Fig. 17.17(a)), then the spectrum estimated at each frequency 
will be significantly influenced by the contribution from the side-lobe, leading to a 
poor spectrum estimate. 

If the main-lobe is very wide (see Fig. 17.17(b)), then a similar effect as in 
Eq. (17.132) takes place, resulting in the failure to resolve closely spaced spec- 
tral lines. Further understanding of leakage and resolution can be gained from 
Fig. 17.17 if we hold the frequency of the first sinusoid fixed at fi = 0.3 and 
vary the frequency (f2) of the second sinusoid. For each value of f2, examine how 
the spectra W ( f —0.3) and W(f — fo) are adding together to result in the final 
spectrum X (f). 


17.7.4 Windowing for Steady Spectrum 


Observe from Fig. 17.14(a) that the non-rectangular windows weigh down the sig- 
nal samples which are near the edges of the window. Therefore, the shape of the 
resulting periodic repetition of the signal will be less sensitive to small variations 
in the value of N, compared to that in the case of rectangular window. We illus- 
trate this in Fig. 17.18 by showing the periodic repetitions of the windowed signal 
(real sinusoid) for N = 11 and N = 13. Observe that the signal in the case of 
Blackman window is very similar for the two values of N, whereas the signals look 
very different in the case of rectangular window. This will affect the shape of the 
spectra resulting from these two windows, as illustrated in Fig. 17.19. 

The choice of the window affects the variations in the shape of the spectrum 
(e.g., height of the peak) with small changes in the signal frequencies. For example, 
if we only change the frequency of one of the sinusoids in a signal consisting of the 
sum of two sinusoids, we expect the spectral shape to remain more or less steady, 
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Figure 17.17. Spectra (N = 50) of two complex sinusoids (equal powers) at frequencies 
0.3 and 0.42 (i.e., W(f —0.3) and W(f —0.42) given in Eq. (17.132)). (a) Rectangular window 
and (b) Blackman window. 


except for changes in the positions of the spectral peaks. But, as the figures show, 
the spectral peaks vary significantly in the case of rectangular window, even with 
small changes in one of the frequencies. On the other hand, the spectra resulting 
from the Blackman window remain quite steady. 

The jittery nature of the spectrum in the case of rectangular window is a result of 
the high spectral leakage resulting from its high side-lobe levels. Through the high 
side-lobes, any small change in the signal in one frequency gets reflected strongly 
throughout the frequency range. 


17.8 Time and Frequency Resolutions 


We saw in Section 17.7 that the frequency resolution of the DFT spectrum (with 
rectangular window) is $. That is, DFT will not be able to resolve two sinusoids 
if their frequencies are spaced at less than x: Hence, the larger the value of N, the 
better will be the frequency resolution, and vice versa. 
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Figure 17.18. Periodic repetitions of the windowed real sinusoid with rectangular and 
Blackman windows. (a) N = 11, (b) N = 13. 
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Figure 17.19. Spectra of the windowed real sinusoid with rectangular and Blackman win- 
dows. (a) N = 11, (b) N = 13. 
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On the other hand, large values of N will result in reducing the time resolution 
of the DFT. That is, choosing N to be large will make it difficult for the DFT to 
reflect the changes in the time domain. 

Suppose that the signal we want to study has frequency components which are 
slowly varying with time. We may use DFT to study how the frequencies are chang- 
ing with time. So, we divide the complete signal record into several short records 
of length N each, and compute the DFT spectrum for each short record. Clearly, 
to track the changes well, we should choose small values for N. Otherwise, with a large 
N, the net changes in frequencies over a duration of N samples may be significant 
and the successive DFT spectra will not be able to show clearly how the frequencies are 
changing. In other words, the time resolution of the DFT is limited to N. Thus, while 
large N is preferred for good frequency resolution, small N is preferred for good time 
resolution. In practice, depending on the scenario under consideration, we should 


strike a compromise between time and frequency resolutions while choosing the 
value of N. 


17.9 Spectral Smoothing 


When we compute the spectrum of a noisy signal using DFT, the estimated spec- 
trum tends to exhibit fluctuations due to the noise effect. In practice, we prefer to 
get a spectrum that is smoothed to remove the fluctuations due to noise (and any 
other random phenomena). This can be done by the technique of spectral smooth- 
ing as described below. 


e Divide the available data record (say, L samples) into shorter records of length 
N each. Let L = MN, i.e., there are M segments of N samples each. 

e Compute the N-point DFT of all the M records. Let Xm,x be the DFT of 
the m” record, with k = 0,1,..., N —1,andm =1,2,..., M. 

e Average the DFT spectra of the M records to obtain the smoothed DFT 
spectrum. That is, 


M 
1 2 

IX? = — > Knick 
Mm m 


», k=0,1,...,N—-1. (17.135) 


Clearly, to get better smoothing effect, we should have large number of records 
(i.e., large M) to average the spectrum. But, if the total number of samples is limited, 
choosing a large M will make the length of each data record (i.e., N) quite small, thus 
leading to poor frequency resolution. 
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17.10 Concluding Remarks 


This chapter is concluded with the following remarks: 


Various techniques for estimation of the power spectrum has been discussed. 
They include the classical (non-parametric) as well as parametric methods. 
DFT uses the rectangular window implicitly while computing the spectrum. 
Non-trivial windows such as Hamming and Blackman help to reduce spectral 
leakage (and minimizes fluctuations in the spectrum) due to their low side- 
lobes. On the other hand, these windows have very wide main-lobes. 
Narrow main-lobe is required for good frequency resolution. The rectangular 
window has the narrowest main-lobe among the various windows. 

Choice of the DFT size, N, determines the trade-off between frequency and 
time resolutions in DFT spectrum. With increase in N, frequency resolution 
improves and time resolution suffers, and vice versa. 

The technique of spectral smoothing can be reduced to minimize fluctuations 
due to noise in spectra, at the expense of frequency resolution. 


Exercises 


17.1. Suppose we have N = 1000 samples from a sample sequence of random 


process. 


(a) Determine the frequency resolution of the Bartlett, Welch (50% 
overlap), and Blackman-Tukey methods for a quality factor Q = 10. 

(b) Determine the record lengths (M) for the Bartlett, Welch (50% over- 
lap), and Blackman-Tukey methods. 


17.2. Determine the mean and the autocorrelation of the sequence x[n], which 


is the output from an ARMA(1,1) process described by the following dif- 
ference equation 


x[n] = 0.5x[n — 1] + w[n] — w[n — 1], 


2 


where w[n] is a white noise process with variance 07. 


17.3. Determine the mean and the autocorrelation of the sequence x[n], gener- 


ated by the MA(2) process described by the following difference equation 
x[n] = w[n] — 2w[n — 1] + w[n — 2], 


where w[n] is a white noise process with variance a. 
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17.4. An AR(2) process is described by the difference equation 
x[n] = 0.81x[n — 2] + w[n], 


where w[n] is a white noise process with variance oĉ. 
Suppose that x[n] is corrupted by an additive white noise process v [n] 
with variance 07. Thus we have, 


yla] = x[n] + o[n]. 


(a) Determine the difference equation for y[n] and thus demonstrate 
that y[n] is an ARMA(2,2) process. Determine the coefficients of 
the ARMA(2,2) process. 

Generalize the result in part (a) to an AR(p) process. 


(b 


wm 


p 
x[n] = — >) ax[n — k] + win}, 


k=1 


and 
yin] = x[n] + v[n]. 


17.5. (a) A student is using an educational software to help understand the 
relationship between signals and spectra. The software is used to gen- 
erate a real signal consisting of two sinusoids. The programme then 
calculates and displays the spectrum of the signal generated as shown 
in Fig. P17.6. Explain why the spectrum is plotted over the positive 
frequencies only. Why is the spectrum not consisting of purely two 
impulses corresponding to the frequencies of the two sinusoids that 
were generated? There seems to be some kind of “noise” next to the 
two spectral lines corresponding to the sinusoids. Is this due to the 
noise of the computer? Is it possible to get rid of this noise and how? 


Spectrum (dB) 
ds 
Oo 


0 20 40 (Hz) 


Figure P17.6. 
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(b) What is the most likely reason that the spectrum of Fig. P17.6 is 


17.6. (a) 


(b 


we 


plotted up to 40 Hz? Will the displayed spectrum change if different 
windowing functions are used? How? If the developer of the software 
would like the calculated spectrum to be as close as possible to the 
theoretical impulses, suggest an appropriate windowing function to 
use and state the restrictions on the sinusoids’ frequencies that the 
student can choose. 

In a biomedical experiment, a signal xq(t) with spectrum as shown 
in Fig. P17.7 is being monitored. Typically, the spectrum consists 
of a background noise component, a fixed large component due to 
a known biological function, and more importantly, a slowly time- 
varying narrow-band component (at frequency fe) due to another 
biological phenomenon under investigation. To detect and track fe, 
the signal is sampled at 1 kHz, divided into non-overlapping blocks, 
appropriately windowed and then passed into a FFT processor. What 
should the block size be if foe is to be tracked at the rate of 20 
times/second? Describe the best scenario such that fe can be esti- 
mated most accurately. What is the resolution for fe under this sce- 


nario? 
E 
= 
O 
3 
a Nw 
0 Je 3 J(kH2) 


Figure P17.7. 


Discuss how the resolution and the stability of the detection of fe in 
Question 17.6(a) will change as different windowing functions are 
used for the two situations when fe is far away and close to the fixed 
high power spectral component. Which windowing function would 
you recommend and why? 


17.7. An autoregressive process of order 2 (AR(2)) is described by the difference 
equation 


x[n] = Sxin — 1] + T — 2] + wf[n], 


where w[n] is a white noise process with variance Ge. 
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(a) Determine the mean and autocorrelation of the sequence x[n]. 
Suppose that x[n] is corrupted by an additive white noise process 
v[n] with variance ae. Thus we have, 


y[n] = x[n] + o[n]. 
(b 


wm 


Show that y[n] is an ARMA(2,2) process and determine the coeffi- 
cients of the ARMA(2,2) process (ARMA here refers to autoregressive 


and moving average). 


~ 
a 
WV 


Generalize the result in Question (b) to an AR(p) process (x[n]) and 
derive an expression for the z-transform of the autocorrelation of the 
process y[n]. 


p 
x[n] = — >) ax[n — k] + win}, 


k=1 


and 


yin] = x[n] + v[n]. 


Appendix A: Appendix 


A.1 Hilbert Transform Demo 


Ts = 0.05; % Sample spacing 
Fs = 1/Ts; % Sampling frequency 
t= -5:Ts:5; % Sample times 


= sinc(t); % Time signal 


8 
N = 2^13; % Number of samples in FFT 
G fftshift (fft(g, N)); 

f (-(N/2) :(N/2-1))/Ne Fs; % Frequency axis 

figure(1); subplot (211); 

plot(t,g); title(’g(t) = sinc(t)’); 

subplot (212); plot(f,abs(G)); title (’Amplitude of FFT of g(t)’); 


gplus = hilbert(g); % Hilbert transform is in imaginary part of gplus 
ghat = imag(gplus); 


Gplus = fftshift(fft(gplus, N)); 
Ghat = fftshift(fft(ghat, N)); 


YY 


figure(2); subplot (211); 
plot(t,ghat); title (’Hilbert transform of g(t) = sinc(t)’); 
subplot (212); plot(f,abs(Ghat)); title (’Amplitude of FFT’); 


W% 

% Plot the pre-envelope 

figure (3); plot(f,abs(Gplus)); 
title(”Amplitude of FFT of gplus(t)’); 


YY 
% Modulate by cosine function with frequency 5 Hz 


xdsb = g .* cos(2#*pix5#t); 

Xdsb = fftshift (fft (xdsb ,N)); 

xssb = g .* cos(2*pi*5*t) - ghat .* sin(2* pix5*t); 
Xssb = fftshift (fft (xssb ,N)); 
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figure (4); subplot(211); 

plot(t, xdsb); title (’Double sideband 
subplot(212); plot(f, abs(Xdsb)); 
title (’Amplitude of FFT of DSB signal 


Who 

figure (5); subplot(211); 

plot(t, xssb); title(’Single sideband 
subplot(212); plot(f, abs(Xssb)); 
title (’Amplitude of FFT of SSB signal 


% END 
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(DSB) time signal’); 


PE 


(SSB) time signal’); 


PE 


Appendix B: Formula Sheets 


B.1 Trigonometric Formulas 


B11 Right-angle Triangle Definition 


Assume that: 0 <0 <5 or 0° <@ < 90° 


opposite 


5 h 
sin(0) = a csc(0) = a 


~~ hyp 


tan(0) = TH cot(0) = a 


B.1.2 Unit Circle Definition 


Assume 0 can be any angle, 
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sin(@) = I csc(0) = 


=|= 


cos(ĝ0) = ł sec(0) = l 
tan() =~ co(0)=} 


x 


B.1.3 Domains of the Trigonometric Functions 


sin(@), V 0 e (—oo, co) csc(0), VOAnz, neZ 
cos(9), V 8 e (—o0, co) sec(9), V 0 Æ (n + 5) x, neZ 
tan(0), VOA(n+35)a, neZ col), VOFnz, neZ 


B.1.4 Ranges of the Trigonometric Functions 


—1 <sin(@) < 1 csc(9) > 1 and csc(@) < —1 
—1 < cos(0) < 1 sec(0) > 1 and sec(0) < —1 


—oo < tan(0) < co —oo < cot(9) < co 


B.2 Identities and Formulas 


B.2.1 Tangent and Cotangent Identities 


anO = Fy O = Sra} 


Identities and Formulas 
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B.2.2 Reciprocal Identities 
sin(8) = TO csc(0) = D 
cos(0) = W sec(@) = O 
tan(0) = z ot) = aO 
B.2.3 Pythagorean Identities 
sin? (8) + cos? (8) = 1 
tan? (0) + 1 = sec? (0) 
1 + cot? (0) = csc? (0) 
B.2.4 Even and Odd Formulas 
sin(—0) = — sin(0) csc(—@) = — csc(A) 
cos(—@) = cos(0) sec(—0) = sec(@) 
tan(—0) = —tan(9)  cot(—0) = — cot(9) 
B.2.5 Periodic Formulas 


If n is an integer, 


sin(@ + 27n) = sin(@) 
cos(9 + 22n) = cos(@) 
tan(@ + mn) = tan(0) 


B.2.6 Double Angle Formulas 


csc(9 + 2an) = csc(A) 
sec(@ + 27n) = sec(O) 
cot(0 + mn) = cot(@) 


sin(20) = 2 sin(@) cos(@) 
cos(29) = cos? (0) — sin? (0) 
= 2cos*(9) — 1 
= 1 —2sin?(6) 


tan(20) = i 


2 tan(@) 
— tan? (8) 
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B.2.7 Degrees to Radians Formulas 


If a is an angle in degrees and r is an angle in radians, then 


T r mta 180°r 
=- > r=— amadas 


180° a 180° 1 


B.2.8 Half-Angle Formulas 


1- 2 
iot ee) 
2 
1 2 
cos(0) = + | 1 + cos(2@) 
2 
1 — cos(20) 
0) = +. | —— 
aot) \ 1 + cos(20) 
B.2.9 Sum and Difference Formulas 


sin(a + £) = sin(a) cos(P) + cos(a) sin(£) 


cos(a + f) = cos(a) cos(P) F sin(a) sin(£) 
tan(a) + tan(f) 


tan(a + p) = 1 + tan(a) tan(B) 


B.210 Product to Sum Formulas 
sin(a) sin(B) = ; [cos(a — B) — cos(a + £)] 
cos(a) cos(B) = ; [cos(a — £) + cos(a + f)] 
sin(a) cos(B) = ; [sin(a + £) + sin(a — £)] 


1 
cos(a) sin(f) = 5 [sin(a + £) — sin(a — £)] 


Unit Circle 463 


B.211 Sum to Product Formulas 


sin(a) + sin(f) = 2 sin (“ 


r) 
sin(a) — sin(f) = 2 cos ( i E) sin (: =P 
f 


cos(a) + cos(f) = 2 cos ( 


cos(a) — cos(f) = —2 sin ( i ) sin (: : £) 


B.212 Co-function Formulas 


sin (5 — 0) =cos(@) cos (4 — 0) = sin() 
csc (5 — 0) =sec(9) sec (5 — 0) = csc(0) 
tan (5 — 0) =cot(9) cot (5 — 8) = tan (0) 


B.3 Unit Circle 


For any ordered pair (x, y) on the unit circle, cos(0) = x and sin(@) = y. 
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Example: 
4r 1 ; 4r V3 
cos | — | = —— and sin{ — } = —-— 
3 2 3 2 


B.4 Inverse Trigonometric Functions 


B.4.1 Definition 
6 = sin !(x) is equivalent to x = sin(@) 
6 = cos !(x) is equivalent to x = cos(0) 


6 = tan t (x) is equivalent to x = tan(@) 


B.4.2 Domain and Range 


Function Domain Range 
@=sin (x) -l<x<l1 -5<0<5 
8 = cos™! (x) -l<x<l 0<O0<z 
@=tan!(x) -oo<x<0o -5<0<5 


B.4.3 Inverse Properties 
The properties hold for x in the domain and 8 in the range. 


sin(sin7!(x)) = x sin! (sin(@)) = 0 
cos(cos!(x)) =x  cos™!(cos(0)) = 0 
tan(tan7!(x)) =x tan! (tan(@)) = 0 


B.4.4 Other Notations 
sin™! (x) = arcsin(x) 
cos™! (x) = arccos(x) 


tan! (x) = arctan(x) 
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B.5 Laws of Sines, Cosines, and Tangents 


Law of Sines Law of Cosines Law of Tangents 
sina) _ sin(B) _ sin) 2 p24 e _ 9p a—b _ tan5(a—f) 
ep a bhe 2becosla) Te = eae 
tan 5(B—0) 


b? = a* + c? —2ac cos(f) ore ~ an 5(B+0) 


1 
De Diy BI a—c __ tanz(a—0) 
c? =a? +b 2ab cos(0) a+c ~~ tan 5(a+0) 


B.6 Complex Numbers 


i= v- P=] Past Pei 


[=a =iJa, a> 0. (a +ib)(a — ib) = a? + b? 


(a +ib)+ (c +id)= (a+c)+i(b+d) la + ib| = Va? + b? 
Complex Modulus 


(a +ib) — (c + id) = (a — c) + i (b — d) (a+ib)* =a— ib 
Complex Conjugate 


(a +ib)(c + id) = (ac — bd) + i(ad +bc) (a +ib)*(a +ib) 
= |a +ib}? =a? +b? 


B.7 Sin, Cosine, and Tangent Functions 


Figure below shows the functional relationship between sin function and the unit 
circle. 
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f (8)=sin(0) 


The following figures illustrates the sin, cos, and tan functions and the table 


shows the values of these functions at specific angle values. 


f(8)=sin(@) : 


+1} ----------+-2-— 


o [0%] § | 3) | F = z $ z ae (Mex sa 
sin) | 0.0 | 4 | Bfio} $ | 4 | oo | -4 | -B } -10 | - | -4 
co) | 10 | 2] 4 | oo} -4 | - | -10] -% | -1 | 00 i 43 
tan(9) | 0.0 a V3 | œ | -Vv3 -5 0.0 5 V3 | =œ | -v3 | -5 
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B.8 Signal-to-noise Ratio 


The relative amount of signal and noise present in a waveform is usually quantified 
by the signal-to-noise ratio (SNR). As the name implies, it is simply the ratio of 
signal to noise, both measured in root-mean-squared (RMS) amplitude and is often 


expressed in decibel (dB). SNR in dB is defined as, 


Signal amplitude (RMS) ) (B.1) 


= 201 
SNRapB °810 (= amplitude (RMS) 


ignal 
=i (epore) (B.2) 


Noise power 


To convert from dB scale to linear scale, 


dB 
SNRļinear = 102. (B.3) 
For example, a SNR of 20dB implies that the RMS value of signal is 10 times 
the RMS value of noise (i.e., 10% = 10). A SNR of +3dB indicates a ratio of 
V2 = 1.414 (i.e.,1020 = 1.414). Similarly, a SNR of 0dB implies that the RMS 


values of the signal and noise are the same (i.e., 105 = 1). 


(a) 
2F— Yona 
0 f x Oa q | 
2 = 4 = L = 
0 0.2 0.4 0.6 0.8 1 
(b) 
2 — a = — ~~al 
0 
-2 4 1 L L J 
0 0.2 0.4 0.6 0.8 1 
c 
5 T i (c) T T 
Dea PASH apa napjat Paa pala 
-5 4 4 4 4 
0 0.2 0.4 0.6 0.8 1 
(d) 
10 T T T T 
0 
-10 S ká rA L 
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Time (Sec.) 
Figure B.1. 


Figure B.1 shows a 5 Hz sinusoidal signal with various amounts of white noise 
added to it. Figure B.1(a) is the 5Hz sinusoid alone (or the SNR is 00). The sinusoid 
with 10dB SNR is shown in Fig. B.1(b). Fig. B.1(c) illustrates the case with 0dB 
SNR and the last figure (Fig. B.1(d)) shows the signal at —10dB SNR. 
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B.9 z-Transform Properties 


Let x[n], xn[n], and x2[n] be three discrete-time signals with corresponding 
z-transforms, defined as, 


CO 


X(z) = > x[n] ”" 
Xið= >) ahe” 
Xa(z) = », xq[n]z~" 


For scalar constants a; and ag, the following z-transform properties hold. 


Property Time Domain z-Domain 
x[n] X (z) 
Notation xi[n] X1(z) 
x2[n] X2(z) 
Linearity a,x, [n] + azx2[n] a, X1(z) + a2 X2(z) 
Time shifting x[n — k] z*X (2) 
z-Scaling aj x[n] Xa 9 
Time reversal x[—n] X(z7!) 
Conjugation x*[n] X*(z*) 
z-Differentiation nxin] = O 
z-Differentiation nk x[n] (—1) zk txo 
Convolution x[n] ® x2[n] X1(z)X2(z) 


B.10 Common z-Transform Pairs 


The table below provides the z-transforms of some of the commonly used discrete- 
time functions. Here, wo = 27 fo is an arbitrary angular frequency. 
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Signal z-Transform ROC 

o[n] 1 All z-domain 
u[n] a Iz] >1 
a”u[n] za |z| > lal 
na”u[n] Ee |z| > lal 
—a"u[—n — 1] ast |z| < lal 
—na"u[—n — 1] i Iz| < |a| 
cos(@on)u[n] ew, lz] > 1 
sin(@on)u[n] miia lz] > 1 
a” cos(opn)uln] tse ee el > al 
a” sin(@on)u[n] az sin(on) |z| > |a| 


1—2az—! cos(wo)+a2z~2 


B.11 Fourier Transform Theorems and Properties 


Let x(t) and y(t) be two non-periodic signals with FTs X(f) and Y(f), respec- 
tively. That is, 


x(t) = I S x(peaf, y= / Yet af 


X(f) = / T r(Qe Pa, Y= I ” yetar. 


For real constants a, a1, a2, fo, and fo, the following properties are derived. 


Property/Theorem Time Domain Frequency Domain 
l x(t) X(f) 
Notation 
y(t) Y(f) 
Linearity a\x(t)+azy(t) a,X(f)+a2Y(f) 
Dilation x(at) Lx (£) 


Conjugation x*(t) X*(-f) 
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Property/Theorem Time Domain Frequency Domain 
Duality X(t) gC f) 
Time shifting x(t — to) PRm 
Frequency shifting e/ 2X fot x(t) X(f — fo) 
Area under X (f) x(0) [roo X Naf 
Area under x(t) [Sox@Mdt X (0) 

Time Differentiation dv) j2afX(f) 
Time Integration [Uox@)dt wap X(f) 
Modulation Theorem x(t)y(t) X(f) @Y(f) 
Convolution Theorem x(t) ® y(t) X(f)Y(f) 


Correlation Theorem x(t) 8 y*(—t) X(f)Y*(f) 


Energy Theorem fRox dt fo |X (fy Pdf 


B.12 Continuous Time Fourier Series: Properties 


Let x(t) and y(t) be two periodic signals with period, Tp = T where fp is 
the fundamental (cyclic) frequency of the signals with the corresponding angular 
frequency, Q, = 27x fp. The Fourier series relationships for both the signals can 


now be written as: 


= i f? 
x(t) = > Xpel kr. where, X;, = = a x(t)e Jk! dt 
| as 


k=—oco 


+00 l Tp 
t) = YpetkOrt, wh Yk = — te TkOo! gt 
y)= $, Yre r; where, Ye T, Jp y(tye 


k=—0o 


Here, Xg and Y; are the Fourier coefficients of x(t) and y(t), respectively. Now, 
for scalar quantities, a, J, and fo, the following properties are hold. 
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Property Periodic Signal Fourier Coefficients 
. x(t) Xk 
Notation 
y(t) Yz 

Linearity ax(t) + By(t) aXe + BY, 
Time shifting x(t — to) X pe Fk pt 
Frequency shifting eJ MQpt y(t) Xk-M 
Conjugation x* (t) x", 
Time reversal x(-t) Xk 
Periodic convolution Í T,* (t)y(t — t)dt Tp XY x 
Multiplication x(t)y(t) balay. fa ae 

; : ais dx(t ; 
Time Differentiation x ) JKkÊQpXk 
Time Integration oa x(t)dt (a) Xk 

X=xX*" k 

Conjugate Symmetry for MS 

onjuga 

Jugate >y y x(t) real Sm{X;} = —Sm{X_z} 


Real Signals 


Real and Even Signals 
Real and Odd Signals 


Parseval’s theorem 


x(t) real and even 


x(t) real and odd 
T Sr, Pat 


[Xx] = [Xl 
LX, = —LX_ 5 
X, real and even 


Xj purely imaginary and odd 


Delta 


B.13 Discrete Time Fourier Series: Properties 


Let x[n] and y[n] be two periodic discrete-time signals with period, N, and fun- 


damental frequency, @p = 2a fp, where fp = 


is the fundamental (cyclic) 


frequency of the signals. Fourier series relationships for x[n] and y[n] can be writ- 


ten as: 


N-1 
x[n] = X,elkoon. here, X, = — 
[n] 2 k w. =N 


N-1 


> x[n]e 72" 


n=0 


N-1 N-1 
5 i j 1 ; 

y[n] = Ype". where, y; = N > y[n]e 7.” 
k=0 n=0 


Here, Xg and Yx are the Fourier coefficients of x[n] and y[n], respectively. 
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Property 


Notation 


Linearity 

Time shifting 
Frequency shifting 
Conjugation 

Time reversal 
Periodic convolution 
Multiplication 


First Difference 


Running Sum 


Conjugate Symmetry for 
Real Signals 


Real and Even Signals 
Real and Odd Signals 


Parseval’s theorem 
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Periodic Signal Fourier Coefficients 
x[n] Xk 
y[n] Yk 
ax[n] + yin] aXk + PYk 
x[n — no] XpeW Fkepno 
ef Morn yin] Xk-M 
x*[n] pa 
x[—n] X-k 
EN x[m]yin — m] NX Yk 
x[n]y[n] Ta WA 
x[n] — x[n — 1] (1 — esky) Xk 
n 1 
Xk = X*k 
Re{ Xx} = Re{X r} 
x[n] real Sm{Xz} = —-Sm{X k} 
[Xx| = |X-«| 
LX, = —LX_5 


x[n] real and even X, real and even 


x[n] real and odd 
Dro [ela]? 


X; purely imaginary and odd 
N-1 
Dito IXa? 


B.14 Uniform Random Variables 


Figure B.2. 
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A random variable x is uniformly distributed in the interval [a, £] if its PDF 
is defined as 


L if a<x<£ß 
fa) = | 0 otherwise ee) 
Here, we have 
1 B i 
Ta | dx = (B.5) 
p p 
my = El] = f shod =z | ip aa (B.6) 
a b-a Ja 2 
B B 2 2 
Px = E[x?] =) x? f(x)dx = =S dx =" al sy 
a p — QA Ja 3 
(B.7) 
EEr 
o2 = varbe] = Eb? — (El? = P= (B.8) 


B.15 Normal (Gaussian) Random Variables 


The PDF is given by, 


fx (x) — 


| $a") (B.9) 
= exp 7 z ; 


e my, is the mean and o, is the standard deviation. 


where 


e The factor - ors is a constant to make the area under the pdf to be unity. 

e fx (x) is symmetric with respect to x = my because the exponent is 
quadratic. This implies that when my = O, the distribution is symmetric 
with respect to the y-axis (i.e., x = 0). 

© The exponent term tends to zero faster as ox decreases. 
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Figure B.3. 


B.16 Central Limit Theorem (CLT) 


If x1, X2, ..., XK be a sequence of independent and identically distributed (i.i.d) 
random variables each having mean my and variance of. Then for K large, the 
distribution of x1 +x2+...+Xx is approximately normal with mean Km, and 
variance K o2. 


It follows from the CLT that Dr is approximately a standard 


normal random variable. Thus for K large, 


pjatat Em 


ENK <x} = Pt < x} (B.10) 


This means that the distribution of an average tends to be Normal (Gaussian), even 
when the distribution from which the average is computed is decidedly non-normal. 
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